-- Logs begin at Tue 2022-07-26 01:47:35 UTC, end at Tue 2022-07-26 03:34:01 UTC. -- Jul 26 03:01:55.569736 dv-cinder-850840-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 03:01:55.579825 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 03:01:55 2022] *** Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: nodename: dv-cinder-850840-2-iscsi Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: machine: x86_64 Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: clock source: unix Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: pcre jit disabled Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: detected number of CPU cores: 4 Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: current working directory: / Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: detected binary path: /usr/bin/uwsgi-core Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: your processes number limit is 47680 Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: your memory page size is 4096 bytes Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: detected max file descriptor number: 2048 Jul 26 03:01:55.582195 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: lock engine: pthread robust mutexes Jul 26 03:01:55.583278 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: thunder lock: enabled Jul 26 03:01:55.583278 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 03:01:55.583278 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 03:01:55.624260 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: Python main interpreter initialized at 0x5562bc9e09c0 Jul 26 03:01:55.624260 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: python threads support enabled Jul 26 03:01:55.624260 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: your server socket listen backlog is limited to 100 connections Jul 26 03:01:55.624260 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: your mercy for graceful operations on workers is 90 seconds Jul 26 03:01:55.624715 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 03:01:55.624715 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: *** Operational MODE: preforking *** Jul 26 03:01:55.624960 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: *** uWSGI is running in multiple interpreter mode *** Jul 26 03:01:55.624960 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: spawned uWSGI master process (pid: 103529) Jul 26 03:01:55.625207 dv-cinder-850840-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 03:01:55.626092 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: spawned uWSGI worker 1 (pid: 103530, cores: 1) Jul 26 03:01:55.626092 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: spawned uWSGI worker 2 (pid: 103531, cores: 1) Jul 26 03:01:55.626254 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 03:01:56.275794 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 03:01:56.276498 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 03:01:57.350385 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:01:57.350385 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: from cryptography.utils import int_from_bytes Jul 26 03:01:57.351070 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:01:57.351070 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: from cryptography.utils import int_from_bytes Jul 26 03:01:57.359259 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:01:57.359259 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: from cryptography.utils import int_from_bytes Jul 26 03:01:57.359723 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:01:57.359723 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: from cryptography.utils import int_from_bytes Jul 26 03:01:59.823457 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 03:01:59.824149 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 03:01:59.824236 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 03:01:59.824555 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 03:01:59.824954 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 03:01:59.824954 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 03:01:59.825112 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 03:01:59.825180 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.825334 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 03:01:59.825421 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.825689 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 03:01:59.825831 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.825920 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 03:01:59.826063 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.826312 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.826453 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.826625 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.826725 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.826989 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.827138 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.827286 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.827375 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.827630 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.827760 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.827942 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.828032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.828218 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.828363 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.828450 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-2-iscsi {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.828518 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.828779 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.828888 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.829083 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.829177 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.829383 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.829493 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.829687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.829800 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-2-iscsi {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.829977 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.830081 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.830291 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.830390 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.830588 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.830674 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.830898 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.831102 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.831521 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.831521 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.831749 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.831852 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.831963 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.832106 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.832318 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.832442 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.832626 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.832756 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.832919 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.833050 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.833240 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.833333 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.833573 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.833661 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.833886 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.833983 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.834199 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.834296 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.834515 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.834611 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-2-iscsi {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.834823 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.834912 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.835169 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.835271 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.835474 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.835576 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.835872 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-2-iscsi {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.835959 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.836177 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.836271 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.836478 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.836579 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.836787 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.836883 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.837098 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.837185 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.837384 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.837482 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.837718 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.837857 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.838032 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.838131 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.838341 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.838427 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.838653 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.838739 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.838987 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.839077 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.839266 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.839349 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.839932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.840026 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.840240 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.840331 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.840534 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.840617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.840828 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.840913 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.841071 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.841161 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.841370 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.841514 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.841680 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.841764 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.841989 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.842072 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.842315 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.842421 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.842591 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.842683 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.842836 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.842921 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.843169 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.843256 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.843478 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.843571 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.843779 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.843862 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.844048 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.844132 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.844364 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.844453 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.844662 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.844753 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.844962 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.845047 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.845260 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.845356 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.845559 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.845652 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.845857 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.845940 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.846163 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.846246 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.846468 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.846560 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.846771 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.846860 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.847092 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.847179 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.847405 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.847505 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.847772 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.847870 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.848022 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.848105 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.848325 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.848410 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.848640 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.848722 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.849036 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.849132 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.849287 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.849373 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.849593 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.849677 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.849928 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.850012 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.850242 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.850338 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.850543 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.850634 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.850841 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.850934 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.851176 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.851266 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.851489 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.851616 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.851786 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.851877 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.852032 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.852115 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.852324 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.852407 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.852620 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.852715 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.852927 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.853011 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.853222 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.853304 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.853536 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.853768 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.853852 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.853928 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.854091 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.854181 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.854396 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.854489 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.854693 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.854783 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855012 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855111 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855311 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855404 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855609 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855691 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855906 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.855988 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.856203 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.856288 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.856502 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.856586 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.856799 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.856893 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.857096 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.857187 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.857404 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.857496 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.857702 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.857791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.858029 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.858116 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.858328 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.858425 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.858629 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.858719 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.858933 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.859030 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.859255 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.859336 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.859551 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.859634 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.859852 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.859950 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.860150 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.860239 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.860458 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.860541 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.860762 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.860852 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.861057 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.861139 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.861355 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.861444 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.861658 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.861748 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.861948 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.862037 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.862247 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.862330 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.862545 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.862628 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.862841 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.862929 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.863163 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.863259 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.863461 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.863548 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.863755 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.863838 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.864052 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.864148 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.864356 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.864449 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.864653 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.864737 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.864946 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.865036 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.865238 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.865328 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.865536 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.865619 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.865839 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.865931 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.866137 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.866219 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.866430 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.866513 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.866724 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.866807 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.867064 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.867151 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.867370 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.867462 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.867674 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.867765 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.867989 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.868083 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.868289 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:01:59.868384 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.868621 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.868705 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.868942 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.869069 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.869253 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.869338 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.869558 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.869655 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.869863 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.869947 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.870181 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.870272 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.870484 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.870568 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.870787 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.870870 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.871123 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.871222 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.871435 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.871520 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.871743 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.871826 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.872053 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.872145 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.872359 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.872475 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.872668 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.872753 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.872977 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.873070 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.873281 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.873372 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.873644 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.873742 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.873965 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.874127 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.874281 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.874370 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.874584 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.874675 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.874897 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.875011 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.875252 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.875335 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.875558 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.875640 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.875868 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.875951 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.876179 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.876300 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.876485 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.876577 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.876789 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.876874 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.877094 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.877178 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.877408 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.877492 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.877739 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.877823 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.878095 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.878189 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.878346 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.878430 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.878648 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.878732 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.878993 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.879082 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.879278 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.879375 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.879583 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.879671 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.879885 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.879969 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.880199 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.880291 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.880505 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.880588 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.880813 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.880903 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.881113 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.881205 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.881421 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.881505 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.881723 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.881808 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.882028 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.882109 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.882329 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.882413 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.882625 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.882708 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.882921 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.883014 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.883242 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.883316 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.883547 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.883632 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.883846 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.883937 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.884151 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.884242 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.884456 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.884539 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.884764 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.884867 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.885070 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.885174 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.885390 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.885524 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.885717 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.885815 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.886028 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.886171 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.886326 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.886458 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.886628 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.886756 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.886928 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.887127 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.887258 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.887410 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.887560 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.887746 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.887878 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.888001 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.888180 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.888298 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.888416 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.888588 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.888718 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.888795 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.889123 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.889265 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.889344 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.889518 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.889649 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.889829 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.889949 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.890161 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.890293 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.890506 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.890596 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.890824 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.891051 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.891173 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.891245 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.891457 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.891542 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.891768 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.891925 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.892091 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.892185 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.892416 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.892528 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.892730 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.892817 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.893023 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.893178 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.893368 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.893493 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.893631 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.893718 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.893936 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.894034 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.894249 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.894370 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.894536 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.894646 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.894832 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.894999 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.895153 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.895291 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.895455 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.895604 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.895752 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.895910 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.896049 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.896219 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.896345 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.896528 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.896641 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.896833 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.896921 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.897143 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.897228 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.897448 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.897532 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.897753 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.897837 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.898059 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.898160 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.898361 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.898448 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.898663 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.898752 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.898995 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.899143 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.899314 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.899407 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.899614 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.899699 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.899917 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.900002 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.900218 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.900314 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.900535 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.900631 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.900846 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.900955 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.901150 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.901236 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.901456 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.901556 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.901760 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.901844 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.902062 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.902146 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.902376 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.902545 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.902680 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.902766 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.903013 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.903112 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.903321 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.903413 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.903639 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.903722 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.903960 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.904117 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.904282 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.904439 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.904595 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.904860 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.904972 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.905179 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.905271 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.905515 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.905608 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.905842 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.905926 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.906152 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.906245 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.906468 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.906552 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.906771 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.906868 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.907157 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.907254 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.907495 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.907589 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.907815 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.907944 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.908138 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.908257 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.908451 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.908563 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.908813 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.908897 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.909127 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.909271 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.909460 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.909662 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.909801 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.909970 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.910063 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.910359 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.910441 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.910669 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.910897 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.911051 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.911242 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.911335 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.911546 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.911632 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.911866 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.911951 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.912191 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.912278 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.912507 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.912588 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.912810 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.912892 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.913118 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.913202 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.913433 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.913516 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.913740 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.913831 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.914046 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.914129 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.914360 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.914444 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.914664 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.914761 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.914984 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.915094 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.915294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.915401 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.915601 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.915706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.915903 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.915992 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.916211 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.916299 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.916509 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.916606 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.916817 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.916906 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.917120 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.917208 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.917418 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.917509 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.917714 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.917804 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.918017 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.918114 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.918320 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.918408 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.918624 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.918736 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.918934 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.919048 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.919271 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.919368 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.919570 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.919660 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.919872 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.919971 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.920189 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.920295 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.920521 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.920604 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.920827 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.920919 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.921125 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.921207 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.921422 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.921505 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.921733 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.921824 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.922038 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.922121 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.922333 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.922416 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.922643 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.922739 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.922997 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.923097 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.923280 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.923371 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.923593 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.923684 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.923894 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.923977 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.924202 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.924286 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.924512 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.924598 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.924816 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.924900 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.925118 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.925202 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.925419 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.925503 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.925720 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.925803 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.926019 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.926102 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.926321 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.926406 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.926626 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.926718 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.926926 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.927028 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.927249 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.927334 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.927550 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.927634 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.927845 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.927937 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.928147 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.928230 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.928452 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.928542 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.928753 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.929036 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.929133 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.929358 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.929450 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.929668 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.929926 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.930067 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.930255 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.930349 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.930570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.930655 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.930887 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.931008 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.931230 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.931313 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.931546 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.931629 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.931845 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.931937 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.932148 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.932234 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.932446 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.932536 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.932743 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.932836 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.933048 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.933152 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.933345 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.933437 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.933642 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.933733 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.933939 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.934031 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.934247 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.934331 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.934543 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.934625 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.934841 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.934932 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.935163 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.935256 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.935460 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.935545 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.935761 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.935846 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.936119 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.936213 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.936425 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.936509 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.936739 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.936824 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.937042 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.937125 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.937342 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.937432 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.937640 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.937731 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.937936 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.938027 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.938232 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.938329 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.938538 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.938621 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.938842 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.938926 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.939169 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.939270 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.939510 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.939600 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.939812 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.939905 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.940133 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.940225 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.940433 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.940517 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.940748 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.940831 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.941043 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.941135 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.941340 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.941424 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.941637 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.941728 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.941940 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.942025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.942240 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.942324 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.942535 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.942620 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.942839 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.942924 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.943162 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.943247 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.943460 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.943551 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.943759 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.943851 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.944055 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.944145 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.944366 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.944449 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.944658 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.944748 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.944963 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.945053 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.945262 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.945352 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.945555 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.945639 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.945850 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.945933 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.946153 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.946257 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.946453 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.946537 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.946747 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.946836 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.947072 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.947172 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.947369 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.947451 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.947666 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.947749 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.947962 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.948055 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.948259 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.948343 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.948554 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.948637 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.948855 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.948939 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.949155 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.949238 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.949458 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.949543 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.949754 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.949878 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.950069 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.950193 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.950375 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.950465 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.950696 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.950781 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.951029 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.951116 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.951336 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.951426 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.951659 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.951749 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.951964 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.952053 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.952266 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.952363 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.952569 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.952658 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.952864 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.953003 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.953167 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.953261 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.953463 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.953620 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.953757 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.953843 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.954053 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.954153 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.954359 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.954443 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.954653 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.954737 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.954999 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.955170 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.955263 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.955341 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.955546 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.955631 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.955840 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.955925 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.956144 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.956228 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.956444 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.956526 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.956742 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.956825 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.957039 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.957122 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.957335 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.957419 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.957648 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.957732 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.957955 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.958038 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.958255 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.958339 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.958586 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.958676 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.958889 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.958990 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.959225 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.959319 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.959531 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.959627 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.959844 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.959927 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.960144 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.960241 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.960445 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.960529 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.960753 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.960843 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.961058 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.961153 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.961364 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.961446 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.961660 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.961748 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.961958 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.962054 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.962271 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.962355 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.962575 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.962658 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.962874 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.963026 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.963215 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.963300 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.963525 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.963608 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.963839 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.963922 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.964141 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.964224 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.964802 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.964892 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.965104 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.965196 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.965405 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.965488 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.965708 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.965791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.966010 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.966106 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.966312 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.966396 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.966614 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.966698 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.966920 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.967016 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.967294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.967380 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.967601 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.967697 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.967904 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.967995 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.968207 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.968290 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.968511 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.968602 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.968810 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.968901 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.969118 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.969208 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.969420 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.969510 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.969722 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.969806 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.970023 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.970105 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.970322 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.970413 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.970626 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.970708 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.970923 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.971030 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.971253 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.971369 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.971566 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.971675 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.971891 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.972005 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.972264 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.972357 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.972567 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.972692 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.972871 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.972958 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.973179 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.973263 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.973486 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.973569 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.973780 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.973862 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.974107 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.974191 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.974422 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.974512 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.974726 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.974818 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.975096 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.975184 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.975386 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.975478 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.975684 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.975775 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.975988 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.976079 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.976306 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.976390 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.976605 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.976696 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.976903 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.976986 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.977199 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.977283 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.977513 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.977604 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.977811 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.977894 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.978123 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.978219 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.978444 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.978530 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.978752 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.978843 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.979096 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.979183 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.979515 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.979601 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.979818 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.979908 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.980123 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.980208 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.980440 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.980524 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.980752 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.980837 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.981065 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.981157 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.981363 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.981449 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.981669 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.981752 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.981971 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.982063 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.982286 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.982376 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.982600 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.982692 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.982930 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.983047 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.983257 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.983354 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.983558 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.983642 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.983873 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.983965 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.984190 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.984287 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.984494 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.984578 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.984816 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.984957 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.985140 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.985370 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.985456 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.985689 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.985772 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.985994 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.986160 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.986309 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.986481 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.986626 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.986793 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.986926 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.987139 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.987236 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.987463 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.987547 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.987774 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.987859 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.988081 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.988202 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.988394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.988478 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.988702 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.988786 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.989010 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.989093 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.989317 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.989402 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.989623 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.989707 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.989924 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.990009 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.990224 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.990320 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.990533 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.990628 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.990828 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.990918 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.991157 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.991290 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.991462 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.991579 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.991762 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.991878 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.992077 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.992199 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.992376 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.992495 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.992680 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.992787 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993015 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993139 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993276 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993395 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993683 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993869 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.993979 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.994190 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.994307 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.994493 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.994601 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.994793 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.994901 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.995137 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.995253 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.995450 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.995558 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.995752 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.995860 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.996076 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.996187 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.996396 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.996503 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.996703 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.996796 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.997010 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.997093 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.997326 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.997417 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.997622 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.997714 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.997919 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.998003 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.998222 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.998306 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.998572 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.998665 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.998871 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.999008 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.999192 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.999287 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.999495 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.999588 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.999790 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:01:59.999880 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.000086 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.000171 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.000383 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.000467 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.000683 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.000765 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.000979 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.001062 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.001281 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.001366 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.001580 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.001662 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.001876 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.001958 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.002174 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.002265 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.002468 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.002551 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.002780 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.002862 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.003125 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.003253 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.003411 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.003499 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.003756 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.003860 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.004048 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.004132 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.004385 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.004475 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.004674 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.004778 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.004985 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.005069 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.005297 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.005387 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.005606 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.005698 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.005912 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.005994 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.006220 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.006312 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.006529 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.006630 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.006835 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.006920 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.007166 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.007251 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.007472 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.007569 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.007781 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.007865 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.008088 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.008173 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.008406 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.008639 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.008956 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.009206 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.009306 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.009573 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.009752 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.009975 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.010065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.010469 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.010615 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.011050 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.011159 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.011292 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.011462 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.011613 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.011775 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.011918 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.012088 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.012240 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.012389 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.012554 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.012693 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.012921 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.013029 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.013237 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.013344 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.013476 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.013647 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.013793 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.013978 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.014145 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.014322 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.014465 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.014632 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.014790 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.014942 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.015153 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.015270 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.015471 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.015624 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.015785 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.015921 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.016100 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.016221 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.016414 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.016595 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.016769 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.016857 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.017084 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.017179 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.017391 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.017476 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.017703 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.017787 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.018005 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.018097 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.018310 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.018394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.018615 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.018706 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.018917 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.019025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.019248 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.019332 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.019557 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.019642 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.019867 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.019952 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.020179 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.020264 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.020492 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.020582 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.020802 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.020886 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.021106 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.021235 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.021417 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.021510 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.021749 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.021932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.022067 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.022241 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.022383 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.022568 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.022700 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.022885 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.023228 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.023326 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.023543 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.023650 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.023852 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.023938 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.024178 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.024262 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.024481 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.024611 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.024780 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.024866 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.025086 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.025171 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.025389 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.025474 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.025687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.025771 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.025996 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.026079 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.026301 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.026386 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.026600 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.026701 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.026903 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.027027 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.027229 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.027314 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.027542 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.027756 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.027841 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.028103 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.028201 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.028414 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.028504 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.028733 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.028965 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.029058 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.029319 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.029404 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.029658 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.029744 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.030012 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.030105 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.030338 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.030427 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.030626 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.030710 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.030935 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.031050 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.031267 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.031361 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.031566 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.031650 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.031864 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.031957 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.032167 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.032252 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.032471 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.032556 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.032769 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.032855 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.033071 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.033152 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.033366 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.033454 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.033681 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.033776 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.033974 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.034062 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.034282 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.034366 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.034579 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.034663 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.034882 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.034993 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.035203 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.035297 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.035500 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.035592 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.035799 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.035883 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.036094 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.036186 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.036395 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.036478 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.036688 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.036808 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.036993 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.037101 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.037286 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.037370 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.037590 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.037681 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.037884 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.038044 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.038184 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.038269 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.038486 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.038569 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.038798 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.038890 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.039128 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.039214 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.039439 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.039522 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.039750 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.039836 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.040053 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.040136 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.040366 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.040450 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.040669 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.040753 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.040972 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.041055 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.041280 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.041409 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.041604 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.041689 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.041917 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.042126 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.042212 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.042452 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.042545 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.042766 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.042851 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.043120 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.043407 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.043505 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.043737 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.043831 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.044039 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.044123 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.044341 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.044439 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.044662 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.044756 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.044967 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.045051 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.045296 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.045395 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.045603 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.045687 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.045911 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.045995 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.046215 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.046299 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.046521 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.046612 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.046824 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.046970 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.047170 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.047281 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.047471 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.047575 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.047774 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.047864 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.048077 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.048168 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.048382 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.048472 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.048686 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.048786 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.048992 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.049082 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.049305 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.049403 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.049618 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.049717 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.049925 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.050014 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.050236 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.050326 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.050546 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.050645 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.050877 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.050989 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.051227 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.051318 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.051563 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.051673 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.051852 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.051956 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.052159 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.052246 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.052470 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.052557 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.052777 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.052862 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.053075 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.053167 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.053386 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.053493 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.053716 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.053819 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.054037 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.054131 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.054340 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.054432 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.054689 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.054778 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.055023 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.055123 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.055339 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.055429 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.055641 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.055725 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.055958 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.056055 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.056263 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.056347 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.056582 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.056670 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.056908 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.057052 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.057231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.057330 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.057542 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.057631 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.057837 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.057927 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.058136 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.058226 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.058432 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.058522 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.058735 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.058826 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.059067 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.059157 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.059373 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.059462 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.059669 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.059759 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.059964 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.060053 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.060267 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.060365 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.060566 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.060656 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.060862 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.060987 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.061219 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.061318 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.061522 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.061627 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.061828 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.061926 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.062120 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.062216 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.062416 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.062503 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.062715 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.062801 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.063044 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.063145 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.063346 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.063430 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.063644 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.063736 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.063948 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.064047 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.064253 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.064348 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.064546 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.064637 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.064842 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.064928 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.065138 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.065223 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.065435 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.065526 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.065735 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.065820 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.066038 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.066122 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.066344 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.066429 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.066645 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.066739 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.066978 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.067121 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.067305 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.067448 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.067595 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.067681 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.067908 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.067993 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.068223 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.068314 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.068529 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.068614 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.068833 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.068925 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.069149 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.069246 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.069452 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.069536 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.069756 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.069840 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.070062 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.070154 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.070365 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.070450 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.070667 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.070752 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.070993 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.071093 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.071306 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.071390 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.071618 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.071702 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.071915 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.072005 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.072225 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.072310 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.072534 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.072617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.072848 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.072933 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.073154 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.073245 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.073455 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.073593 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.073777 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.073863 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.074085 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.074169 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.074391 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.074495 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.074692 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.074777 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.075016 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.075103 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.075320 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.075416 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.075628 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.075720 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.075933 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.076024 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.076235 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.076321 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.076567 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.076654 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.076881 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.076965 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.077187 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.077271 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.077500 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.077584 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.077800 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.077890 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.078115 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.078199 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.078428 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.078510 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.078749 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.078839 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.079080 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.079167 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.079407 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.079490 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.079725 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.079825 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.080035 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.080120 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.080341 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.080425 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.080638 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.080730 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.080877 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 03:02:00.081013 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.081329 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.081641 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.081947 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:02:00.082192 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 03:02:00.236824 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO dbcounter [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Registered counter for database nova_api Jul 26 03:02:00.237153 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO dbcounter [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Registered counter for database nova_api Jul 26 03:02:00.260724 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.262591 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_db.sqlalchemy.engines [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.268226 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writer thread running {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.270204 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writer thread running {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.322702 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.context [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f14e75b2-f05e-40ea-9398-2d8da20a61a4(cell1) {{(pid=103531) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 03:02:00.325152 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.context [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f14e75b2-f05e-40ea-9398-2d8da20a61a4(cell1) {{(pid=103530) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 03:02:00.326713 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:02:00.328349 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:02:00.329137 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:02:00.329267 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_concurrency.lockutils [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:02:00.330715 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_concurrency.lockutils [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:02:00.331117 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:02:00.331650 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_concurrency.lockutils [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:02:00.333077 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO dbcounter [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Registered counter for database nova_cell0 Jul 26 03:02:00.333713 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_concurrency.lockutils [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:02:00.335744 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO dbcounter [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Registered counter for database nova_cell0 Jul 26 03:02:00.338440 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO dbcounter [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Registered counter for database nova_cell1 Jul 26 03:02:00.341737 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO dbcounter [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Registered counter for database nova_cell1 Jul 26 03:02:00.346402 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.348920 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.350625 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_db.sqlalchemy.engines [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.353901 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_db.sqlalchemy.engines [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.355566 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writer thread running {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.357561 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writer thread running {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.359603 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writer thread running {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.362833 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writer thread running {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.498021 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO dbcounter [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Registered counter for database nova_cell0 Jul 26 03:02:00.504872 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO dbcounter [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Registered counter for database nova_cell0 Jul 26 03:02:00.508048 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_db.sqlalchemy.engines [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.513095 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writer thread running {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.513826 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG oslo_db.sqlalchemy.engines [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:02:00.518161 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writer thread running {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:02:00.849746 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: WARNING keystonemiddleware.auth_token [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:02:00.851984 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: WARNING keystonemiddleware.auth_token [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:02:00.857025 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: WARNING keystonemiddleware.auth_token [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:02:00.859302 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: WARNING keystonemiddleware.auth_token [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:02:01.198337 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: WARNING keystonemiddleware.auth_token [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:02:01.201046 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: WARNING keystonemiddleware.auth_token [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:02:01.204456 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: WARNING keystonemiddleware.auth_token [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:02:01.207097 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: WARNING keystonemiddleware.auth_token [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:02:01.209705 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562bc9e09c0 pid: 103530 (default app) Jul 26 03:02:01.211767 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:02:01.212368 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562bc9e09c0 pid: 103531 (default app) Jul 26 03:02:01.212932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-131a2257-896a-4b84-a929-3add5fc086c3 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Jul 26 03:02:01.213367 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Tue Jul 26 03:02:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:17.501267 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:17.502449 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Jul 26 03:03:17.503121 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:17.515095 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writing DB stats nova_api:SELECT=3 {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:17.516238 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writing DB stats nova_cell0:SELECT=3 {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:17.517314 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writing DB stats nova_cell1:SELECT=3 {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:17.518584 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:18.415351 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-61df71d2-05c5-445f-bce5-e15a3c20be5c admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:18.450435 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-61df71d2-05c5-445f-bce5-e15a3c20be5c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.941031 Jul 26 03:03:18.451208 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 26 03:03:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:20.633378 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:20.634715 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-c6d1b581-20fe-4fae-aea4-7f50ba3bca6e None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jul 26 03:03:20.635240 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:21.172831 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-e8017614-b0f3-4161-8e4d-6ec16e7d1028 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "ram": 256, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:21.192953 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:03:21.192953 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: warnings.warn(msg) Jul 26 03:03:21.223129 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-e8017614-b0f3-4161-8e4d-6ec16e7d1028 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.581316 Jul 26 03:03:21.223891 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:21.237878 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_api:SELECT=3 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:21.238867 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_cell1:SELECT=3 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:21.244232 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_cell0:SELECT=3 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:21.244232 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:21.451571 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-a43aa3d7-c22f-467f-a8e1-72c081166f31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:21.455942 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:03:21.455942 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: warnings.warn(msg) Jul 26 03:03:21.516178 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-a43aa3d7-c22f-467f-a8e1-72c081166f31 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283795 Jul 26 03:03:21.516969 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 26 03:03:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:23.765536 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-e8017614-b0f3-4161-8e4d-6ec16e7d1028 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:23.767200 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-e8017614-b0f3-4161-8e4d-6ec16e7d1028 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Jul 26 03:03:23.767761 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:24.409606 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-5dcc15cc-1d88-4eb2-82f0-e8eee93a8fd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:24.428505 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:03:24.428505 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: warnings.warn(msg) Jul 26 03:03:24.451408 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-5dcc15cc-1d88-4eb2-82f0-e8eee93a8fd6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676725 Jul 26 03:03:24.452736 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:24.464720 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-1ca75b3f-b7ca-4ca7-b338-b351e730e8c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:24.467592 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:03:24.467592 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: warnings.warn(msg) Jul 26 03:03:24.504479 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-1ca75b3f-b7ca-4ca7-b338-b351e730e8c3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043771 Jul 26 03:03:24.518109 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 26 03:03:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:26.731007 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-5dcc15cc-1d88-4eb2-82f0-e8eee93a8fd6 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:26.731007 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-5dcc15cc-1d88-4eb2-82f0-e8eee93a8fd6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 26 03:03:26.731007 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:27.105526 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-363bf0e6-c644-4791-a2f3-847f2e9bbdab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "disk": 10, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:27.124966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-363bf0e6-c644-4791-a2f3-847f2e9bbdab admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.388790 Jul 26 03:03:27.125729 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:27.137915 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-ceab975b-5afc-45a0-bce2-0aa9a246fd58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:27.164629 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-ceab975b-5afc-45a0-bce2-0aa9a246fd58 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030558 Jul 26 03:03:27.165228 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 26 03:03:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:29.367887 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-363bf0e6-c644-4791-a2f3-847f2e9bbdab admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:29.369543 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-363bf0e6-c644-4791-a2f3-847f2e9bbdab admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002335 Jul 26 03:03:29.370355 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:29.799608 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-d884c294-05ed-4915-b327-680f57728f23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "disk": 10, "vcpus": 2, "swap": 0, "name": "ds2G"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:29.820361 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-d884c294-05ed-4915-b327-680f57728f23 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444223 Jul 26 03:03:29.820830 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:29.833215 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-5f4db2de-9262-426e-82a4-84f63731c411 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:29.859591 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-5f4db2de-9262-426e-82a4-84f63731c411 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030325 Jul 26 03:03:29.860387 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 26 03:03:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:32.076254 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-d884c294-05ed-4915-b327-680f57728f23 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:32.077238 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-d884c294-05ed-4915-b327-680f57728f23 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jul 26 03:03:32.077892 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:32.510033 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-317bca19-9810-4644-b69b-c9650d2d4761 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:32.532185 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-317bca19-9810-4644-b69b-c9650d2d4761 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447466 Jul 26 03:03:32.533119 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:32.545352 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-bafe49de-815e-4204-bf43-820136219b61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:32.578098 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-bafe49de-815e-4204-bf43-820136219b61 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036485 Jul 26 03:03:32.583368 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 26 03:03:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:03:34.804801 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-317bca19-9810-4644-b69b-c9650d2d4761 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:34.805885 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-317bca19-9810-4644-b69b-c9650d2d4761 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jul 26 03:03:34.806304 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:35.257278 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-45527b70-bd0f-421d-8c9e-84ddbabcce4c admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:35.282832 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-45527b70-bd0f-421d-8c9e-84ddbabcce4c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469974 Jul 26 03:03:35.283401 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 26 03:03:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:03:37.881165 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-317bca19-9810-4644-b69b-c9650d2d4761 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:37.882130 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-317bca19-9810-4644-b69b-c9650d2d4761 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 26 03:03:37.882543 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:38.349273 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-38f64508-9fe3-46a1-8168-0051c8264302 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "1"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:38.374262 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-38f64508-9fe3-46a1-8168-0051c8264302 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.485068 Jul 26 03:03:38.375091 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:38.392291 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-65a368fe-d7d1-4303-985c-6ecf37fab96a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:38.426877 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-65a368fe-d7d1-4303-985c-6ecf37fab96a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040129 Jul 26 03:03:38.427519 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 26 03:03:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:40.660487 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-38f64508-9fe3-46a1-8168-0051c8264302 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:40.661425 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-38f64508-9fe3-46a1-8168-0051c8264302 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 26 03:03:40.662015 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:41.063718 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-7fef7c56-542f-4857-8a5c-0cd0d7f9150b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:41.084656 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-7fef7c56-542f-4857-8a5c-0cd0d7f9150b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415842 Jul 26 03:03:41.085198 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:41.098682 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-942d33ab-77df-4d09-9d1a-3b841bb135cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:41.125049 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-942d33ab-77df-4d09-9d1a-3b841bb135cd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030085 Jul 26 03:03:41.125887 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 26 03:03:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:43.384118 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-7fef7c56-542f-4857-8a5c-0cd0d7f9150b admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:43.385127 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-7fef7c56-542f-4857-8a5c-0cd0d7f9150b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 26 03:03:43.385525 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:43.765023 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-04d25495-2aad-4fa0-8c0b-26db04ac198a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "ram": 4096}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:43.786589 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-04d25495-2aad-4fa0-8c0b-26db04ac198a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.394790 Jul 26 03:03:43.787352 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 03:03:43.799481 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-527593c3-b77a-4a33-9e3a-893b55985458 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:43.826533 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-527593c3-b77a-4a33-9e3a-893b55985458 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030581 Jul 26 03:03:43.827257 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 26 03:03:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:46.047336 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-04d25495-2aad-4fa0-8c0b-26db04ac198a admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:46.048436 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-04d25495-2aad-4fa0-8c0b-26db04ac198a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001681 Jul 26 03:03:46.048837 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:46.502719 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-fea93e58-12ff-4bdd-8070-603382a29a09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:46.522130 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-fea93e58-12ff-4bdd-8070-603382a29a09 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465228 Jul 26 03:03:46.522736 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:03:46.535030 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-cbb32d5c-c07a-4574-a758-7ae8801b353c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:46.561862 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-cbb32d5c-c07a-4574-a758-7ae8801b353c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030572 Jul 26 03:03:46.574437 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 26 03:03:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:03:48.750796 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-fea93e58-12ff-4bdd-8070-603382a29a09 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:03:48.752507 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-fea93e58-12ff-4bdd-8070-603382a29a09 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Jul 26 03:03:48.752899 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:03:49.204018 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-74274d3a-0407-4b45-b303-6acc3a7a368c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "id": "5", "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:49.224111 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-74274d3a-0407-4b45-b303-6acc3a7a368c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465171 Jul 26 03:03:49.224774 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 26 03:03:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 03:03:49.236846 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-b6df2fbb-c70e-471b-90e9-f872431ee2b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:03:49.241880 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:03:49.267105 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-b6df2fbb-c70e-471b-90e9-f872431ee2b8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033898 Jul 26 03:03:49.267611 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 26 03:03:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:04:09.139991 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-74274d3a-0407-4b45-b303-6acc3a7a368c admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:09.141820 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-74274d3a-0407-4b45-b303-6acc3a7a368c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 26 03:04:09.141820 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:04:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:09.613227 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-270c0f3b-ef18-4a5d-9bf5-d0304f056116 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:09.636360 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-270c0f3b-ef18-4a5d-9bf5-d0304f056116 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.487869 Jul 26 03:04:09.637281 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 26 03:04:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:04:10.735756 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-74274d3a-0407-4b45-b303-6acc3a7a368c admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:10.737207 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-74274d3a-0407-4b45-b303-6acc3a7a368c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Jul 26 03:04:10.737700 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:11.286365 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-ac5bb770-7189-4f14-8cbb-5b1f61881994 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:11.292137 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.wsgi [None req-ac5bb770-7189-4f14-8cbb-5b1f61881994 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-ac5bb770-7189-4f14-8cbb-5b1f61881994 admin admin] Request method failure captured: Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Accept: application/json Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Accept-Encoding: gzip, deflate Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Connection: keep-alive Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Content-Length: 0 Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Host: 10.222.0.42 Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Openstack-Api-Version: compute 2.90 Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Openstack-System-Scope: None Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: User-Agent: python-novaclient Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Auth-Token: gAAAAABi31mqcaYGBlZAGNilmMOcmvmf5HkZlayXiQMYBvMOLs-horg0JT-cMPN-eMVy0sSuiMDw-x4fu0X6_jaDko-wbmuCMAN8G8k_o61_3J7AYeZnMaHFtf5_ma6IWcGbZajL_wPb12TvHsvv4vDTrZQ4GOqPMD6TK-RNdseUhsOd-WiEoLg Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Domain-Id: None Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Domain-Name: None Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Identity-Status: Confirmed Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Is-Admin-Project: True Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Domain-Id: default Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Domain-Name: Default Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Name: admin Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Role: reader,admin,member Jul 26 03:04:11.295424 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Roles: reader,admin,member Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant: admin Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant-Name: admin Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User: admin Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Domain-Id: default Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Domain-Name: Default Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Id: 84df6af7bcfb4cfca1045798a2ef6d69 Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Name: admin Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: method: > Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: exception: Flavor 42 could not be found. Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: action_args: {'id': '42'} Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:04:11.296966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:11.297838 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.298932 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-ac5bb770-7189-4f14-8cbb-5b1f61881994 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:04:11.300081 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-ac5bb770-7189-4f14-8cbb-5b1f61881994 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.420980 Jul 26 03:04:11.300081 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 26 03:04:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 422 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 03:04:11.307431 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-261b9322-9926-4dda-beef-fb0d3e5ea4b7 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:11.311842 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:04:11.331174 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-261b9322-9926-4dda-beef-fb0d3e5ea4b7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027747 Jul 26 03:04:11.332057 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 26 03:04:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:04:11.343804 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-9c149f75-fbff-4396-ba11-90084d398cb4 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:11.368141 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-9c149f75-fbff-4396-ba11-90084d398cb4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029107 Jul 26 03:04:11.368661 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 26 03:04:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:04:11.378588 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-02586d77-78dd-4bac-bec3-69a41b327f71 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:11.384976 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.wsgi [None req-02586d77-78dd-4bac-bec3-69a41b327f71 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-02586d77-78dd-4bac-bec3-69a41b327f71 admin admin] Request method failure captured: Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Accept: application/json Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Accept-Encoding: gzip, deflate Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Connection: keep-alive Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Content-Length: 0 Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Host: 10.222.0.42 Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Openstack-Api-Version: compute 2.90 Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Openstack-System-Scope: None Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: User-Agent: python-novaclient Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Auth-Token: gAAAAABi31mqcaYGBlZAGNilmMOcmvmf5HkZlayXiQMYBvMOLs-horg0JT-cMPN-eMVy0sSuiMDw-x4fu0X6_jaDko-wbmuCMAN8G8k_o61_3J7AYeZnMaHFtf5_ma6IWcGbZajL_wPb12TvHsvv4vDTrZQ4GOqPMD6TK-RNdseUhsOd-WiEoLg Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Domain-Id: None Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Domain-Name: None Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Identity-Status: Confirmed Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Is-Admin-Project: True Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Domain-Id: default Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Domain-Name: Default Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Name: admin Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Role: reader,admin,member Jul 26 03:04:11.388394 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Roles: reader,admin,member Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant: admin Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant-Name: admin Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User: admin Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Domain-Id: default Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Domain-Name: Default Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Id: 84df6af7bcfb4cfca1045798a2ef6d69 Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Name: admin Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: method: > Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: exception: Flavor 42 could not be found. Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: action_args: {'id': '42'} Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:04:11.389791 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:11.390617 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:11.391962 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-02586d77-78dd-4bac-bec3-69a41b327f71 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:04:11.393184 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-02586d77-78dd-4bac-bec3-69a41b327f71 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014829 Jul 26 03:04:11.393184 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 26 03:04:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 03:04:12.393697 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-9c149f75-fbff-4396-ba11-90084d398cb4 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:12.394697 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-9c149f75-fbff-4396-ba11-90084d398cb4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 26 03:04:12.395091 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:12.957500 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-5a48d868-f465-434c-a5cf-4aedd2e6f11f admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:12.963567 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.wsgi [None req-5a48d868-f465-434c-a5cf-4aedd2e6f11f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-5a48d868-f465-434c-a5cf-4aedd2e6f11f admin admin] Request method failure captured: Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Accept: application/json Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Accept-Encoding: gzip, deflate Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Connection: keep-alive Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Content-Length: 0 Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Host: 10.222.0.42 Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Openstack-Api-Version: compute 2.90 Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Openstack-System-Scope: None Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: User-Agent: python-novaclient Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Auth-Token: gAAAAABi31ms1D75VHjl0OAm4sAPBwvYnUC1TsdfDTKD56r1i5tpsEBGE3Rnt1GbBSTTOOMNkW6TXsKrIQx8NT2t7ff1Jp3ClhRV-d0ENDDG9aZbsgG5xKOWorqfeMLGYrGt6ayS4qMiHjxp569mCsox8D2KyGJwL1nT-0DaXyZ-mXpS1kDvLAI Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Domain-Id: None Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Domain-Name: None Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Identity-Status: Confirmed Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Is-Admin-Project: True Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Domain-Id: default Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Domain-Name: Default Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Name: admin Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Role: reader,admin,member Jul 26 03:04:12.965065 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Roles: reader,admin,member Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant: admin Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant-Name: admin Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User: admin Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Domain-Id: default Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Domain-Name: Default Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Id: 84df6af7bcfb4cfca1045798a2ef6d69 Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Name: admin Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: method: > Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: exception: Flavor 84 could not be found. Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: action_args: {'id': '84'} Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:04:12.966513 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:12.967570 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:12.969064 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-5a48d868-f465-434c-a5cf-4aedd2e6f11f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:04:12.970462 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-5a48d868-f465-434c-a5cf-4aedd2e6f11f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.433972 Jul 26 03:04:12.970462 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 26 03:04:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 03:04:12.980323 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-736c4890-4ff9-4936-8129-ea3fc8c2da33 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:12.996046 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-736c4890-4ff9-4936-8129-ea3fc8c2da33 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021664 Jul 26 03:04:12.996583 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 26 03:04:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:04:13.006721 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-7d6a9dbd-c3f7-4670-89bc-f0c80612d576 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:13.022556 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-7d6a9dbd-c3f7-4670-89bc-f0c80612d576 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019425 Jul 26 03:04:13.023133 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 26 03:04:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:04:13.032874 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-bc3e86cc-1106-439e-825a-33409b444a79 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:13.038532 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.wsgi [None req-bc3e86cc-1106-439e-825a-33409b444a79 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-bc3e86cc-1106-439e-825a-33409b444a79 admin admin] Request method failure captured: Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Accept: application/json Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Accept-Encoding: gzip, deflate Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Connection: keep-alive Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Content-Length: 0 Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Host: 10.222.0.42 Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Openstack-Api-Version: compute 2.90 Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Openstack-System-Scope: None Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: User-Agent: python-novaclient Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Auth-Token: gAAAAABi31ms1D75VHjl0OAm4sAPBwvYnUC1TsdfDTKD56r1i5tpsEBGE3Rnt1GbBSTTOOMNkW6TXsKrIQx8NT2t7ff1Jp3ClhRV-d0ENDDG9aZbsgG5xKOWorqfeMLGYrGt6ayS4qMiHjxp569mCsox8D2KyGJwL1nT-0DaXyZ-mXpS1kDvLAI Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Domain-Id: None Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Domain-Name: None Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Identity-Status: Confirmed Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Is-Admin-Project: True Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Domain-Id: default Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Domain-Name: Default Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Name: admin Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Role: reader,admin,member Jul 26 03:04:13.040056 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Roles: reader,admin,member Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant: admin Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant-Name: admin Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User: admin Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Domain-Id: default Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Domain-Name: Default Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Id: 84df6af7bcfb4cfca1045798a2ef6d69 Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Name: admin Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: method: > Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: exception: Flavor 84 could not be found. Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: action_args: {'id': '84'} Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:04:13.041520 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:13.042434 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:13.043574 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-bc3e86cc-1106-439e-825a-33409b444a79 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:04:13.045108 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-bc3e86cc-1106-439e-825a-33409b444a79 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012192 Jul 26 03:04:13.045108 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 26 03:04:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 03:04:14.026699 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-7d6a9dbd-c3f7-4670-89bc-f0c80612d576 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:14.027705 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-7d6a9dbd-c3f7-4670-89bc-f0c80612d576 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 26 03:04:14.028116 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:14.591328 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-7f826aff-9ad1-452b-8701-ebff66dc2d18 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:14.597195 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.wsgi [None req-7f826aff-9ad1-452b-8701-ebff66dc2d18 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-7f826aff-9ad1-452b-8701-ebff66dc2d18 admin admin] Request method failure captured: Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Accept: application/json Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Accept-Encoding: gzip, deflate Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Connection: keep-alive Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Content-Length: 0 Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Host: 10.222.0.42 Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Openstack-Api-Version: compute 2.90 Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Openstack-System-Scope: None Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: User-Agent: python-novaclient Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Auth-Token: gAAAAABi31mtxH3WL6uxTtbpOXTN7LgfQWW-x_EwhcN_CR1bg4Je8ADtY1cRhHfss3IHSWhDCelxGsmjHjxv3rIWREbqS-glWY_Mf4vjpkGjilnPv_vR_5N5bomtIF1AaSYYegTihqJRDmYEK2wBTBv74yhep0JizJhfOCUWEiA08wySBiUxjuo Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Domain-Id: None Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Domain-Name: None Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Identity-Status: Confirmed Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Is-Admin-Project: True Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Domain-Id: default Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Domain-Name: Default Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Project-Name: admin Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Role: reader,admin,member Jul 26 03:04:14.598706 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Roles: reader,admin,member Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant: admin Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-Tenant-Name: admin Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User: admin Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Domain-Id: default Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Domain-Name: Default Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Id: 84df6af7bcfb4cfca1045798a2ef6d69 Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: X-User-Name: admin Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: method: > Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: exception: Flavor 451 could not be found. Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: action_args: {'id': '451'} Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:04:14.600294 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:14.601231 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.602687 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-7f826aff-9ad1-452b-8701-ebff66dc2d18 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:04:14.603976 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-7f826aff-9ad1-452b-8701-ebff66dc2d18 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.428532 Jul 26 03:04:14.603976 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 26 03:04:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 03:04:14.610205 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-52cb8353-2773-4cd3-b57d-a415a6bd95dd admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:14.625975 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-52cb8353-2773-4cd3-b57d-a415a6bd95dd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019477 Jul 26 03:04:14.626538 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 26 03:04:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:04:14.638181 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:14.653879 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020396 Jul 26 03:04:14.654440 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 26 03:04:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:04:14.669175 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-0ab0b5b7-274c-4ff8-b7c6-823d45b886f1 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:14.674896 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.wsgi [None req-0ab0b5b7-274c-4ff8-b7c6-823d45b886f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-0ab0b5b7-274c-4ff8-b7c6-823d45b886f1 admin admin] Request method failure captured: Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Accept: application/json Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Accept-Encoding: gzip, deflate Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Connection: keep-alive Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Content-Length: 0 Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Host: 10.222.0.42 Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Openstack-Api-Version: compute 2.90 Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Openstack-System-Scope: None Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: User-Agent: python-novaclient Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Auth-Token: gAAAAABi31mtxH3WL6uxTtbpOXTN7LgfQWW-x_EwhcN_CR1bg4Je8ADtY1cRhHfss3IHSWhDCelxGsmjHjxv3rIWREbqS-glWY_Mf4vjpkGjilnPv_vR_5N5bomtIF1AaSYYegTihqJRDmYEK2wBTBv74yhep0JizJhfOCUWEiA08wySBiUxjuo Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Domain-Id: None Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Domain-Name: None Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Identity-Status: Confirmed Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Is-Admin-Project: True Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Domain-Id: default Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Domain-Name: Default Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Project-Name: admin Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Role: reader,admin,member Jul 26 03:04:14.676426 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Roles: reader,admin,member Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8c4cb2e7662425d87dcbcca96df5974"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant: admin Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant-Id: b8c4cb2e7662425d87dcbcca96df5974 Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-Tenant-Name: admin Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User: admin Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Domain-Id: default Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Domain-Name: Default Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Id: 84df6af7bcfb4cfca1045798a2ef6d69 Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: X-User-Name: admin Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: method: > Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: exception: Flavor 451 could not be found. Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: action_args: {'id': '451'} Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:04:14.678025 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:14.679032 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: ERROR nova.api.openstack.wsgi Jul 26 03:04:14.680317 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-0ab0b5b7-274c-4ff8-b7c6-823d45b886f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:04:14.681549 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-0ab0b5b7-274c-4ff8-b7c6-823d45b886f1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014618 Jul 26 03:04:14.681549 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 26 03:04:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 03:04:15.813816 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:15.814867 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 26 03:04:15.815314 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:04:16.383058 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-40e53b0f-9ffd-478f-8667-417723416415 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:04:16.404772 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-40e53b0f-9ffd-478f-8667-417723416415 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.452762 Jul 26 03:04:16.405300 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 26 03:04:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:04:17.514747 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:17.515810 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 26 03:04:17.516197 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:18.072412 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-d6f6bf3d-d08e-4f74-958e-a37f782891b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:04:18.095378 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-d6f6bf3d-d08e-4f74-958e-a37f782891b1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.443929 Jul 26 03:04:18.095926 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 26 03:04:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:04:19.069956 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:19.070966 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 26 03:04:19.071377 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:19.616121 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-cb2b5340-b0a8-4532-8afc-c53b6ebb0993 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:04:19.638388 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-cb2b5340-b0a8-4532-8afc-c53b6ebb0993 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.426705 Jul 26 03:04:19.638975 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 26 03:04:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 03:04:20.614700 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:20.615770 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 26 03:04:20.616153 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:21.165916 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-736bca69-9c9f-4d64-b4c9-0b5f64b26fe2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:04:21.187375 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-736bca69-9c9f-4d64-b4c9-0b5f64b26fe2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.425057 Jul 26 03:04:21.187906 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 26 03:04:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:04:22.162266 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:22.163314 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 26 03:04:22.163742 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:04:22.718857 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-519e1909-0591-4af7-9838-f70658c4ad4f admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:04:22.744181 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-519e1909-0591-4af7-9838-f70658c4ad4f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.443028 Jul 26 03:04:22.744718 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Tue Jul 26 03:04:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:05:14.821600 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:05:14.822612 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-f7189706-47b6-41da-9cbe-4a2a73a731dd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 26 03:05:14.823220 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 26 03:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:05:14.833335 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:05:15.238537 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-3c5f7710-f6d9-44d5-b48e-fec109b31cd6 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:05:15.259522 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-3c5f7710-f6d9-44d5-b48e-fec109b31cd6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430746 Jul 26 03:05:15.260063 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 26 03:05:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:05:15.281052 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG dbcounter [-] [103530] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:05:15.284904 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-8d3e30e0-0ebf-4785-8eee-1dbf914a5673 admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:05:15.293197 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-8d3e30e0-0ebf-4785-8eee-1dbf914a5673 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013621 Jul 26 03:05:15.293718 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1282 bytes} [Tue Jul 26 03:05:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:05:15.305432 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-d3b01819-a510-4756-bf4c-7868a1e750a7 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:05:15.313301 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-d3b01819-a510-4756-bf4c-7868a1e750a7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011460 Jul 26 03:05:15.313784 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1285 bytes} [Tue Jul 26 03:05:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:05:15.325423 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:05:15.333282 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011748 Jul 26 03:05:15.333718 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1285 bytes} [Tue Jul 26 03:05:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:05:15.347614 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-b1021cfb-5263-4c43-b715-07a39a0173b1 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:05:15.357776 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-b1021cfb-5263-4c43-b715-07a39a0173b1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015442 Jul 26 03:05:15.358338 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1282 bytes} [Tue Jul 26 03:05:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:08:34.514368 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:34.515761 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001830 Jul 26 03:08:34.516146 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:08:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:08:34.656229 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_api:SELECT=6 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:08:34.837077 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-f977d330-53a1-4c1f-9627-9790432eb16a admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:34.839474 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:08:34.839474 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: warnings.warn(msg) Jul 26 03:08:34.840692 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-f977d330-53a1-4c1f-9627-9790432eb16a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:34.841164 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-f977d330-53a1-4c1f-9627-9790432eb16a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:34.841939 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-f977d330-53a1-4c1f-9627-9790432eb16a admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:34.842367 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-f977d330-53a1-4c1f-9627-9790432eb16a admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:34.876109 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-f977d330-53a1-4c1f-9627-9790432eb16a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.222520 Jul 26 03:08:34.876664 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 26 03:08:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:08:35.708367 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:35.709375 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 26 03:08:35.709772 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:08:35.907746 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-e1972b1a-0554-4555-a336-bbb42ad6ee1b admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:35.910169 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:08:35.910169 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: warnings.warn(msg) Jul 26 03:08:35.911397 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-e1972b1a-0554-4555-a336-bbb42ad6ee1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:35.911903 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-e1972b1a-0554-4555-a336-bbb42ad6ee1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:35.912613 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-e1972b1a-0554-4555-a336-bbb42ad6ee1b admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:35.913033 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-e1972b1a-0554-4555-a336-bbb42ad6ee1b admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:35.932494 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-e1972b1a-0554-4555-a336-bbb42ad6ee1b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085699 Jul 26 03:08:35.933045 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 26 03:08:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:08:47.195721 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:47.196876 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Jul 26 03:08:47.197258 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:08:47.340968 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_cell0:SELECT=4 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:08:47.341744 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_cell1:SELECT=4 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:08:47.342424 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG dbcounter [-] [103531] Writing DB stats nova_api:SELECT=8 {{(pid=103531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:08:47.417227 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-199d83bb-f8f1-46ec-a71a-e7ae55a3b996 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:47.419713 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:08:47.419713 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: warnings.warn(msg) Jul 26 03:08:47.420910 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-199d83bb-f8f1-46ec-a71a-e7ae55a3b996 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:47.421368 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-199d83bb-f8f1-46ec-a71a-e7ae55a3b996 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:47.422150 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-199d83bb-f8f1-46ec-a71a-e7ae55a3b996 admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:47.422574 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-199d83bb-f8f1-46ec-a71a-e7ae55a3b996 admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:47.447836 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-199d83bb-f8f1-46ec-a71a-e7ae55a3b996 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.114238 Jul 26 03:08:47.448373 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 26 03:08:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:08:48.263898 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: DEBUG nova.api.openstack.wsgi [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] Calling method '>' {{(pid=103530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:48.264894 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: INFO nova.api.openstack.requestlog [None req-4279a2e5-943b-4c16-b8e6-753dfcfdd9bb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 26 03:08:48.265287 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: [pid: 103530|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 26 03:08:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:08:48.462722 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG nova.api.openstack.wsgi [None req-613a692a-ae90-4923-a49c-88e490292bb2 admin admin] Calling method '>' {{(pid=103531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:08:48.466081 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 03:08:48.466081 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: warnings.warn(msg) Jul 26 03:08:48.467314 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-613a692a-ae90-4923-a49c-88e490292bb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:48.467844 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-613a692a-ae90-4923-a49c-88e490292bb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:48.469189 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-613a692a-ae90-4923-a49c-88e490292bb2 admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:08:48.469709 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: DEBUG oslo_concurrency.lockutils [None req-613a692a-ae90-4923-a49c-88e490292bb2 admin admin] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:08:48.495464 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: INFO nova.api.openstack.requestlog [None req-613a692a-ae90-4923-a49c-88e490292bb2 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093394 Jul 26 03:08:48.496031 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: [pid: 103531|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 26 03:08:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:09:45.932656 dv-cinder-850840-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 03:09:45.933218 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: Tue Jul 26 03:09:45 2022 - graceful shutdown triggered... Jul 26 03:09:45.933645 dv-cinder-850840-2-iscsi devstack@n-api.service[103530]: Gracefully killing worker 1 (pid: 103530)... Jul 26 03:09:45.933991 dv-cinder-850840-2-iscsi devstack@n-api.service[103531]: Gracefully killing worker 2 (pid: 103531)... Jul 26 03:09:46.934485 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: worker 1 buried after 1 seconds Jul 26 03:09:46.934485 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: worker 2 buried after 1 seconds Jul 26 03:09:46.934485 dv-cinder-850840-2-iscsi devstack@n-api.service[103529]: goodbye to uWSGI. Jul 26 03:09:46.937146 dv-cinder-850840-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 03:09:46.938039 dv-cinder-850840-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 03:09:46.942474 dv-cinder-850840-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 03:09:46.956065 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 03:09:46 2022] *** Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: nodename: dv-cinder-850840-2-iscsi Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: machine: x86_64 Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: clock source: unix Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: pcre jit disabled Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: detected number of CPU cores: 4 Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: current working directory: / Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: detected binary path: /usr/bin/uwsgi-core Jul 26 03:09:46.958102 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: your processes number limit is 47680 Jul 26 03:09:46.958812 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: your memory page size is 4096 bytes Jul 26 03:09:46.958812 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: detected max file descriptor number: 2048 Jul 26 03:09:46.958812 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: lock engine: pthread robust mutexes Jul 26 03:09:46.958812 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: thunder lock: enabled Jul 26 03:09:46.958812 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 03:09:46.958812 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 03:09:46.998279 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: Python main interpreter initialized at 0x561f1b2fc9c0 Jul 26 03:09:46.998279 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: python threads support enabled Jul 26 03:09:46.998279 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: your server socket listen backlog is limited to 100 connections Jul 26 03:09:46.998279 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: your mercy for graceful operations on workers is 90 seconds Jul 26 03:09:46.998720 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 03:09:46.998720 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: *** Operational MODE: preforking *** Jul 26 03:09:46.999093 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: *** uWSGI is running in multiple interpreter mode *** Jul 26 03:09:46.999093 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: spawned uWSGI master process (pid: 118043) Jul 26 03:09:46.999315 dv-cinder-850840-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 03:09:46.999616 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: spawned uWSGI worker 1 (pid: 118059, cores: 1) Jul 26 03:09:47.000384 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: spawned uWSGI worker 2 (pid: 118060, cores: 1) Jul 26 03:09:47.000384 dv-cinder-850840-2-iscsi devstack@n-api.service[118043]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 03:09:47.649195 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 03:09:47.649863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 03:09:48.774166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:09:48.774166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: from cryptography.utils import int_from_bytes Jul 26 03:09:48.774811 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:09:48.774811 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: from cryptography.utils import int_from_bytes Jul 26 03:09:48.779239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:09:48.779239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: from cryptography.utils import int_from_bytes Jul 26 03:09:48.779706 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 03:09:48.779706 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: from cryptography.utils import int_from_bytes Jul 26 03:09:51.150724 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 03:09:51.151368 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 03:09:51.151657 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 03:09:51.151855 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 03:09:51.152096 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 03:09:51.152510 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.152830 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.153149 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.153435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.153765 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.154064 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.154407 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.154722 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.155191 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.155433 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.155775 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.156093 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-2-iscsi {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.156375 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.156817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.157148 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.157462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.157750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.158048 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.158373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.158859 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.160443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.160443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.160443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.160443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.160850 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.160850 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.161160 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.161399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.161713 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.162031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.162416 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-2-iscsi {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.162729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.163063 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.163359 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.163784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.164075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.164400 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.164693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.164999 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.165318 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.165630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.165950 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.166328 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.166572 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.166861 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.167183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.167504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.167810 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.168111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.168392 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.168650 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.168949 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.169258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.169569 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.169879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.170124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.170366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.170732 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.171070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.171374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.171677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.171985 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.172283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.172569 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.172895 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.173182 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.173483 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.173801 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.174100 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.174420 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.174924 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.175116 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.175431 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.175693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.175993 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.176324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.176636 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.176917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.177227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.177549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.177858 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.178161 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.178459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.178756 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.179126 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.179420 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.179666 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.179966 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.180257 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.180560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.180859 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.181344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.181519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.181742 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.182092 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.182337 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.182720 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.182931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.183258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.183556 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.183847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.184165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.184453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.184780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.185148 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.185393 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.185708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.185994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.186367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.186684 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.187006 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.187325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.187631 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.187933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.188231 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.188543 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.188843 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.189222 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.189447 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.189742 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.190043 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.190349 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.190648 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.190989 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.191260 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.191559 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.191861 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.192246 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.192447 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.192757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.193038 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.193347 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.193669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.193987 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.194289 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.194581 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.194891 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.195386 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.195569 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.195903 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.196225 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.196550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.196868 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.197178 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.197486 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.197793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.198113 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.198470 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.198714 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.199043 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.199411 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.199677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.200000 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.200309 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.200619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.200930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.201234 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.201545 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.201911 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.202232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.202540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.202873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.203240 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.203548 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.203870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.204180 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.204487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.204790 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.205582 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.205775 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.206107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.206415 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.206725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.207055 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.207364 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.207669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.207972 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.208277 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.208611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.208924 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.209226 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.209611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.209835 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.210139 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.210445 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.210748 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.211070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.211370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.211668 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.211979 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.212274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.212673 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.212919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.213214 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.213545 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.213841 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.214145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.214450 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.214822 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.215075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.215384 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.215778 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.215988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.216307 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.216618 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.216923 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.217227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.217816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.217976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.218549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.218549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.218851 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.219118 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.219424 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.219805 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.220047 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.220353 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.220686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.221013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.221311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.221626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.221949 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.222256 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.222551 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.222854 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.223175 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.223481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.223783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.224065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.224365 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.224662 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.224961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.225254 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.225549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.225940 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.226164 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.226459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.226755 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.227146 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.227415 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.227713 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.228053 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.228381 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.228698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.229008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.229321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.229624 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.230006 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.230227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.230531 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.230841 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.231176 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.231482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.231805 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.232107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.232431 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.232728 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.233042 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.233385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.233693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.234029 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.234354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.234666 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.235102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.235376 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.235686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.236098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.236284 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.236583 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.236886 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.237345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.237508 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.237800 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.238147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.238414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.238795 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.239051 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.239347 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.239655 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.239979 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.240302 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.240611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.240909 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.241224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.241527 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.241837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.242140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.242994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.242994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.243194 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.243364 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.243673 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.243952 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.244256 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.244560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.244863 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.245156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.245454 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.245763 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.246077 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.246385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.246696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.247029 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.247330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.247625 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.247939 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.248241 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.248540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.248904 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.249204 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.249545 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.249848 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.250145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.250456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.250772 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.251104 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.251417 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.251719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.252025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.252340 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.252645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.252950 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.253254 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.253557 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.253865 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.254166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.254480 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.254781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.255107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.255411 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.255708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.256014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.256324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.256917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.257244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.257553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.257862 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.258174 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.258487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.258811 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.259156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.259493 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.259793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.260097 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.260402 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.260690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.260991 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.261287 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.261599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.261892 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.262191 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.262487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.262781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.263095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.263392 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.263698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.263994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.264296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.264645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.264962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.265262 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.265555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.265853 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.266147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.266477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.266784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.267128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.267458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.267786 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.268075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.268369 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.268681 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.268979 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.269271 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.269568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.269873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.270169 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.270465 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.270768 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.271094 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.271399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.271706 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.271999 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.272300 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.272595 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.272898 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.273199 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.273493 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.273786 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.274086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.274388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.274674 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.275002 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.275299 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.275597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 03:09:51.276060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.276137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 03:09:51.276216 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.276216 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.276395 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 03:09:51.276481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.276720 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 03:09:51.276841 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.276992 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 03:09:51.277095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.277320 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.277420 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.277635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.277735 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.277942 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.278130 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.278286 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.278438 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.278581 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.278732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.278873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.279062 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.279208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.279357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.279517 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.279677 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.279838 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.279981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.280194 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.280339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.280481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.280623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.280774 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.280916 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850840-2-iscsi {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.281070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.281221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.281385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.281538 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.281689 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.281832 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.281971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.282141 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.282285 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.282443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.282593 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.282749 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.282902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.283070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.283213 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.283370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.283525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.283699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.283850 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.283993 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.284133 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.284290 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.284482 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.284626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.284626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.284904 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.285074 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.285236 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.285236 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.285518 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.285669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.285819 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.285976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.286122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.286263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.286405 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.286547 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.286697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.286697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.287483 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850840-2-iscsi {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.287647 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.287791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.287932 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.288112 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.288267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.288410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.288669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.288817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.288960 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.289112 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.289263 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.289414 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.289568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.289717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.289872 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.290303 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.290454 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.290597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.290747 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.290747 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.290747 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.291204 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.291360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.291510 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.291660 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.291820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.291977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.292127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.292271 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.292412 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.292554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.292704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.292856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.293007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.293156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.293298 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.293447 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.293604 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.293765 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.293916 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.293916 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.294186 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.294893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.295103 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.295250 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.295409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.295409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.295721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.295866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.296018 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.296018 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.296345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.296490 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.296642 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.297581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.297740 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.297740 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.298034 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.298034 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.298420 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.298420 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.298888 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.299072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.299224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.299367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.299517 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.299659 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.299800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.300023 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.300178 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.300337 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.300487 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.300487 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.300779 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.300936 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.301086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.301229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.301378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.301527 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.301683 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.301829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.301978 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.302135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.302283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.302433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.302593 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.302750 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.302893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.303132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.303284 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.303426 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.303582 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.303726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.303869 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.304017 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.304159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.304318 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.304470 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.304624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.304765 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.304907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.305048 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.305213 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.305356 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.305506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.305647 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.305790 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.305932 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.306082 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.306224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.306373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.306533 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.306684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.306834 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.307013 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.307760 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.307923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.308068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.308210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.308351 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.308508 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.308659 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.308820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.309109 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.309272 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.309272 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.309999 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.310175 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.310322 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.310464 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.310679 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.310839 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.311001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.311150 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.311370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.311553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.311713 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.311879 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.312030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.312180 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.312323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.312473 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.312615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.312769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.312921 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.313063 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.313203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.313353 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.313504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.313655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.313809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.313960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.314109 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.314265 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.314425 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.314578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.314728 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.314878 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.315070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.315213 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.315366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.315510 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.315669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.315826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.315977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.316127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.316276 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.316427 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.316578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.316732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.316876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.317016 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.317157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.317675 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.318002 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.318172 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.318317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.318467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.318619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.318761 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.318917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.319214 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.319363 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.319516 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.319668 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.319818 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.319973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.320123 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.320277 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.320426 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.320586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.320746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.320899 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.321109 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.321264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.321407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.321549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.321706 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.321849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.321998 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.322148 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.322302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.322444 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.322599 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.322743 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.322883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.323047 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.323199 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.323351 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.323501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.323652 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.323803 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:09:51.323945 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.324107 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.324264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.324421 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.324565 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.324714 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.324856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.325005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.325202 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.325354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.325505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.325646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.325797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.325946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.326113 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.326113 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.326391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.326532 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.326673 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.326813 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.327052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.327210 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.327369 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.327846 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.328183 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.328342 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.328507 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.328651 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.328792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.328933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.329083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.329370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.329517 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.329660 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.329811 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.329961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.330478 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.330641 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.330798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.330976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.331141 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.331299 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.331457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.331619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.331768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.331930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.331930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.332229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.332377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.332540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.332697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.332846 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.333013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.333163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.333393 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.333546 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.333702 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.333857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.334005 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.334152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.334320 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.334478 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.334627 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.334781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.334937 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.335242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.335410 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.335569 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.335718 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.335874 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.336022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.336170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.336331 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.336480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.336635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.336784 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.336931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.337098 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.337250 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.337407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.337555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.338047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.338373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.338545 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.338697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.338853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.339019 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.339170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.339441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.339612 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.339781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.339938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.340087 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.340234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.340389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.340552 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.340708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.340856 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.341003 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.341150 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.341150 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.341526 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.341690 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.341859 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.342008 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.342163 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.342323 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.342505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.342671 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.342829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.343041 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.343204 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.343361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.343511 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.343659 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.343815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.343975 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.344131 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.344308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.344458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.344606 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.344754 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.344911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.345073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.345230 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.345387 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.345544 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.345699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.345859 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.346021 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.346170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.346317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.346465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.346612 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.346759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.346920 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.347101 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.347251 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.347408 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.347556 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.348054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.348219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.348559 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.348716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.348716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.349000 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.349158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.349307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.349543 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.349699 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.349847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.350005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.350173 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.350330 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.350487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.350642 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.350792 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.350983 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.351141 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.351301 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.351449 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.351693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.351848 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.352005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.352159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.352319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.352467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.352622 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.352780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.352945 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.353107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.353263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.353421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.353688 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.353856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.354014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.354172 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.354337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.354337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.354641 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.354804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.354973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.355126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.355275 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.355476 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.355628 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.355795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.355945 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.356093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.356242 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.356407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.356589 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.356749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.356907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.357056 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.357211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.357361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.357525 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.357710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.358232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.358397 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.358652 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.358926 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.359194 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.359378 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.359559 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.359718 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.360655 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.360822 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.360990 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.361183 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.361353 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.361505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.361656 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.361811 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.361811 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.362124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.362274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.362422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.362579 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.362737 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.362889 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.363127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.363286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.363444 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.363594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.363755 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.363904 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.364065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.364220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.364379 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.364528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.364692 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.364841 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.364995 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.365143 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.365298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.365462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.365625 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.365783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.365931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.366089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.366236 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.366393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.366542 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.366689 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.366837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.367014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.367168 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.367332 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.367488 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.367488 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.367793 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.367943 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.368429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.368600 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.368867 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.369112 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.369266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.369423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.369582 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.369751 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.369913 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.370063 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.370217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.370366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.370520 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.370773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.370773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.371133 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.371133 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.371435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.371435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.371735 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.371882 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.372030 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.372178 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.372326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.372487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.372636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.372808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.372956 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.373104 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.373251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.373477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.373638 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.373809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.373969 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.374119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.374276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.374439 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.374596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.374765 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.374914 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.374914 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.375233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.375391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.375540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.375696 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.375851 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376315 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376620 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376777 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.376924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.377222 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.377378 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.377527 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.377680 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.377835 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.377991 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.378155 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.378561 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.378719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.378886 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.379129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.379284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.379446 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.379595 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.379743 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.379890 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.380048 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.380197 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.380354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.380503 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.380660 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.380901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.381070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.381238 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.381389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.381545 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.381711 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.381860 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.382022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.382179 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.382328 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.382484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.382647 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.382805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.382989 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.383159 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.383318 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.383467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.383624 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.383773 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.383929 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.384087 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.384244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.384410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.384601 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.384753 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.384899 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.385054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.385221 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.385378 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.385526 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.385681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.385829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.385985 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.386140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.386301 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.386450 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.386597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.386755 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.386755 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.387096 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.387277 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.387444 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.387603 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.387762 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.387919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.388084 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.388234 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.388649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.388810 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.388959 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.389107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.389270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.389484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.389640 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.389790 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.389945 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.390103 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.390265 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.390422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.390587 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.390744 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.390912 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.391173 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.391333 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.391500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.391500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.391784 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.391936 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.392098 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.392247 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.392395 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.392549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.392706 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.392868 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.393028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.393190 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.393339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.393498 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.393646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.393808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.393959 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.394108 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.394264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.394414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.394645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.394798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.394994 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.395153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.395301 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.395462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.395624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.395773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.395930 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.396079 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.396235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.396398 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.396555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.396704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.396859 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.397016 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.397180 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.397329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.397487 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.397635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.397635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.397924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.398089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.398296 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.398458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.398890 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.399087 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.399240 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.399403 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.399553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.399709 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.399880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.400029 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.400184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.400348 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.400497 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.400645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.400791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.400938 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.401099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.401256 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.401406 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.401556 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.401711 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.401870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.402032 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.402181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.402330 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.402486 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.402642 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.402791 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.402999 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.403166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.403166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.403448 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.403597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.403757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.403925 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.404080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.404237 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.404393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.404542 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.404703 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.404854 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.405427 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.405427 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.406477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.406637 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.406800 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.406993 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.407162 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.407320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.407469 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.407618 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.407774 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.407929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.408077 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.408232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.408389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.408553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.408732 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.409167 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.409329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.409478 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.409625 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.409784 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.409941 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.410091 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.410239 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.410387 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.410534 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.410695 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.410853 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.411042 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.411223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.411382 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.411541 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.411698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.411856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.412004 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.412151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.412299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.412461 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.412611 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.412758 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.412906 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.413062 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.413228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.413390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.413548 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.413695 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.413844 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.414000 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.414147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.414308 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.414465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.414620 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.414775 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.414930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.415117 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.415288 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.415444 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.415599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.415747 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.415895 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.416054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.416211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.416403 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.416563 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.416711 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.416858 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.417015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.417189 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.417339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.417486 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.417634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.417782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.417946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418397 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418545 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418700 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.418869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.420225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.421417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.423158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.424320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.425528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.426644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.427820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.428929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.430216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.431418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.432789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.434083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.434083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.434083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.434083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.434083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.434083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.434083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.435116 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.435116 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.435116 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.435116 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.435713 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.435713 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.436003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.436222 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.436561 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.436862 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.437175 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.437479 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.437780 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.438079 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.438377 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.438692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.439023 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.439416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.439638 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.439940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.440252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.440560 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.440865 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.441175 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.441476 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.442028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.442336 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.442674 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.443003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.443326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.443649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.443971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.444276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.444600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.444925 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.445280 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.445581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.446219 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.446518 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.446817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.447143 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.447445 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.447742 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.448038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.448337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.448635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.448931 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.449220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.449514 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.449813 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.450128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.450432 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.450730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.451063 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.451357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.451692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.452041 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.452368 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.452686 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.453000 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.453322 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.453625 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.453941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.454252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.454561 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.454870 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.455639 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.455951 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.456262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.456571 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.457239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.457559 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.457871 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.458184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.458717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.459062 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.459373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.459734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.459984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.460292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.460600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.460950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.461213 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.461518 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.461823 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.462145 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.462461 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.462781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.463139 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.463451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.463698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO dbcounter [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Registered counter for database nova_api Jul 26 03:09:51.463856 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.464054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.464360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.464708 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.465017 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.465319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.465626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.465933 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.466239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.466545 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.466884 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.467217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.467556 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.467864 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.468170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.468476 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.468782 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.469100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.469427 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.469745 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.470050 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.470359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.470667 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.471210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.471522 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.471849 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.472168 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.472483 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.472791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.473099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.473418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.473718 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.474014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.474317 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.474617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.474912 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.475248 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.475553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.475850 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.476162 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.476464 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.476989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.477328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.477634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.477950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.478266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.478873 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.478873 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.479221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.479484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.479843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.480102 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.480408 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.480732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.481391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.481699 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.482001 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.482323 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.482601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.482898 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.483417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.483750 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.483945 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.484073 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.484317 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.484624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.484918 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.485215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.485511 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.485795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.486098 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.486392 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.486694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.487011 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.487319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.487617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.487920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.488264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.488578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.488880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.489178 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.489494 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.490242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.490561 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.490656 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writer thread running {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:51.490880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.491194 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.491532 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.491852 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.492410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.492738 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.493047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.493378 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.493701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.494001 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.494282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.494580 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.494894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.495225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.495528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.495832 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.496135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.496437 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.496738 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.497039 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.497337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.497639 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.497940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.498239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.498539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.498866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.499197 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.499530 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.499844 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.500172 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.500459 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.500767 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.501075 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.501376 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.501677 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.501976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.502283 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.502604 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.502908 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.503232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.503647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.503950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.504263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.504574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.504876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.505189 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.505501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.505805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.506116 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.506420 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.506740 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.507095 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.507417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.507733 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.508030 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.508327 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.508625 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.508927 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.509236 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.509539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.509836 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.510131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.510436 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.510731 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.511056 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.511354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.511716 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.511951 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.512245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.512542 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.512839 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.513136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.513432 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.513727 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.514029 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.514323 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.514677 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.514992 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.515294 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.515589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.515911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.516235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.516545 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.516863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.517166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.517480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.517783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.518095 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.518408 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.518716 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.519051 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.519381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.519684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.519990 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.520295 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.520601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.520903 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.521211 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.521535 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.521859 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.522158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.522475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.522788 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.523128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.523436 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.523742 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.524065 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.524368 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.524671 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.524971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.525274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.525575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.525885 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.526188 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.526493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.526801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.527136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.527451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.527764 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.528065 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.528382 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.528698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.529039 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.529348 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.529681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.530026 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.530337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.530642 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.530938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:09:51.531201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118060) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 03:09:51.545111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.context [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f14e75b2-f05e-40ea-9398-2d8da20a61a4(cell1) {{(pid=118059) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 03:09:51.549257 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:09:51.550821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:09:51.551618 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:09:51.553892 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:09:51.555930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO dbcounter [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Registered counter for database nova_cell0 Jul 26 03:09:51.559844 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO dbcounter [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Registered counter for database nova_cell1 Jul 26 03:09:51.567224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.569198 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.576055 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writer thread running {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:51.577372 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writer thread running {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:51.592607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Registered counter for database nova_api Jul 26 03:09:51.612901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.620023 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:51.675261 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.context [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f14e75b2-f05e-40ea-9398-2d8da20a61a4(cell1) {{(pid=118060) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 03:09:51.679265 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:09:51.680815 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:09:51.681583 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:09:51.683886 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:09:51.685900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Registered counter for database nova_cell0 Jul 26 03:09:51.689838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Registered counter for database nova_cell1 Jul 26 03:09:51.697122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.699003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.705685 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:51.707353 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:51.723258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO dbcounter [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Registered counter for database nova_cell0 Jul 26 03:09:51.730007 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.734593 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writer thread running {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:51.860949 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO dbcounter [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Registered counter for database nova_cell0 Jul 26 03:09:51.868696 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_db.sqlalchemy.engines [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118060) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:09:51.873946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writer thread running {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 03:09:52.045445 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: WARNING keystonemiddleware.auth_token [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:09:52.052823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: WARNING keystonemiddleware.auth_token [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:09:52.189711 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:09:52.197064 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:09:52.390708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: WARNING keystonemiddleware.auth_token [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:09:52.397086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: WARNING keystonemiddleware.auth_token [None req-dcb66452-9ea7-48c8-99c9-a49b0ebb1d68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:09:52.402652 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f1b2fc9c0 pid: 118059 (default app) Jul 26 03:09:52.538606 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 03:09:52.544666 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: WARNING keystonemiddleware.auth_token [None req-ad664683-1ce3-43b8-9c2d-479cb4405624 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 03:09:52.550134 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561f1b2fc9c0 pid: 118060 (default app) Jul 26 03:10:32.903070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:32.904237 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:32.905140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:32.906205 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:33.262175 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:33.266995 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:33.269374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:33.271492 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:10:34.306285 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4695ec3b-c9d1-4a50-9f4f-c4b2de32c8f0 tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Action: 'create', calling method: .version_select at 0x7f5f7b658940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-551686931", "metadata": {"Type": "work"}}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:34.490166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-47071b34-2d2d-4041-a8a3-5ac8846f4f96 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Action: 'create', calling method: .version_select at 0x7f5f7b658940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1465182276", "metadata": {"Type": "work"}}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-47071b34-2d2d-4041-a8a3-5ac8846f4f96 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Request method failure captured: Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 122 Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31spm28Go_ou8dKhX0V3NT5eSJ0TeTLc0Zsmk8jpai-CCUwLvbmzu4UXJyN4v2eVpXjT8ZTomHpoVDNiZbhgw9a87yQuW-SULHo-aWZk9jAYj_s15vpYTAdFartfJm2zHzd9KIAtBPbKohbML5Aqjt5G-h-7U274lyXCfCtQQaTWkM0 Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:10:34.500105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 504dbd85957345e699eba48ddab99ed2 Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1465182276", "metadata": {"Type": "work"}}} Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: Jul 26 03:10:34.503627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1465182276', 'metadata': {'Type': 'work'}}}} Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise error Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:10:34.504692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 03:10:34.506190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 03:10:34.508574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 03:10:34.508574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.510295 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-47071b34-2d2d-4041-a8a3-5ac8846f4f96 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:10:34.513398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-47071b34-2d2d-4041-a8a3-5ac8846f4f96 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.269993 Jul 26 03:10:34.515795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Jul 26 03:10:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 03:10:34.529200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6631c01e-1430-46b5-871a-a6e0ea5dc034 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Action: 'create', calling method: .version_select at 0x7f5f7b658f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-978177060", "metadata": {"Type": "work"}}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6631c01e-1430-46b5-871a-a6e0ea5dc034 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Request method failure captured: Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 119 Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31spm28Go_ou8dKhX0V3NT5eSJ0TeTLc0Zsmk8jpai-CCUwLvbmzu4UXJyN4v2eVpXjT8ZTomHpoVDNiZbhgw9a87yQuW-SULHo-aWZk9jAYj_s15vpYTAdFartfJm2zHzd9KIAtBPbKohbML5Aqjt5G-h-7U274lyXCfCtQQaTWkM0 Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:10:34.537215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 504dbd85957345e699eba48ddab99ed2 Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-978177060", "metadata": {"Type": "work"}}} Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: Jul 26 03:10:34.538830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-978177060', 'metadata': {'Type': 'work'}}}} Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise error Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi '0' Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:10:34.539827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 03:10:34.541439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 03:10:34.542749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 03:10:34.542749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.547088 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6631c01e-1430-46b5-871a-a6e0ea5dc034 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:10:34.549377 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6631c01e-1430-46b5-871a-a6e0ea5dc034 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027275 Jul 26 03:10:34.550704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 2/2] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Jul 26 03:10:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:10:34.563744 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e8d8c6b2-c47c-4305-9853-bf298ab88869 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Action: 'create', calling method: .version_select at 0x7f5f7b510550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-870568958", "metadata": {"Type": "work"}}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e8d8c6b2-c47c-4305-9853-bf298ab88869 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Request method failure captured: Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 118 Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31spm28Go_ou8dKhX0V3NT5eSJ0TeTLc0Zsmk8jpai-CCUwLvbmzu4UXJyN4v2eVpXjT8ZTomHpoVDNiZbhgw9a87yQuW-SULHo-aWZk9jAYj_s15vpYTAdFartfJm2zHzd9KIAtBPbKohbML5Aqjt5G-h-7U274lyXCfCtQQaTWkM0 Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:10:34.569523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 504dbd85957345e699eba48ddab99ed2 Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-870568958", "metadata": {"Type": "work"}}} Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: Jul 26 03:10:34.571099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-870568958', 'metadata': {'Type': 'work'}}}} Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise error Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi '' Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:10:34.572635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 03:10:34.574163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 03:10:34.575574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 03:10:34.575574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:34.576938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e8d8c6b2-c47c-4305-9853-bf298ab88869 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:10:34.578623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e8d8c6b2-c47c-4305-9853-bf298ab88869 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022706 Jul 26 03:10:34.580037 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 3/3] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Jul 26 03:10:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:10:34.592156 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f4e9eb62-0b99-4f6f-8b96-2618b77be5ce tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Calling method '.version_select at 0x7f5f7b510f70>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:35.025698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-f4e9eb62-0b99-4f6f-8b96-2618b77be5ce tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] HTTP exception thrown: Volume tempest-invalid-1933842271 could not be found. Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f4e9eb62-0b99-4f6f-8b96-2618b77be5ce tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Request method failure captured: Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1933842271 HTTP/1.1 Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31spm28Go_ou8dKhX0V3NT5eSJ0TeTLc0Zsmk8jpai-CCUwLvbmzu4UXJyN4v2eVpXjT8ZTomHpoVDNiZbhgw9a87yQuW-SULHo-aWZk9jAYj_s15vpYTAdFartfJm2zHzd9KIAtBPbKohbML5Aqjt5G-h-7U274lyXCfCtQQaTWkM0 Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:10:35.032817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 504dbd85957345e699eba48ddab99ed2 Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Volume tempest-invalid-1933842271 could not be found. Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'tempest-invalid-1933842271'} Jul 26 03:10:35.034354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1933842271 could not be found. (HTTP 404) (Request-ID: req-9bc88c21-7b2c-4e90-8277-c83f6a10e50e) Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.035354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 03:10:35.036783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1933842271 could not be found. Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:10:35.038229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1933842271 could not be found. Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1933842271 could not be found. Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f4e9eb62-0b99-4f6f-8b96-2618b77be5ce tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Returning 404 to user: Volume tempest-invalid-1933842271 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:10:35.040086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f4e9eb62-0b99-4f6f-8b96-2618b77be5ce tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1933842271" status: 404 len: 99 microversion: 2.1 time: 0.453164 Jul 26 03:10:35.042586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 4/4] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Jul 26 03:10:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1933842271 => generated 99 bytes in 458 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 03:10:35.058331 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4cb6fe35-155e-4349-b2a9-d63ae943fc20 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008649 Jul 26 03:10:35.065054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Jul 26 03:10:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 03:10:35.078129 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-14de7b4d-a874-4797-90cc-dd4cfc88ab21 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010604 Jul 26 03:10:35.083170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 6/6] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Jul 26 03:10:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 03:10:35.099296 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a26e05dd-3a43-48e4-89df-de9f6ba8aac4 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Calling method '.version_select at 0x7f5f7b445820>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:35.212321 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-a26e05dd-3a43-48e4-89df-de9f6ba8aac4 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] HTTP exception thrown: Volume cdda5559-6813-4c48-bf29-b8f9197b1725 could not be found. Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a26e05dd-3a43-48e4-89df-de9f6ba8aac4 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Request method failure captured: Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/os-volumes/cdda5559-6813-4c48-bf29-b8f9197b1725 HTTP/1.1 Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31spm28Go_ou8dKhX0V3NT5eSJ0TeTLc0Zsmk8jpai-CCUwLvbmzu4UXJyN4v2eVpXjT8ZTomHpoVDNiZbhgw9a87yQuW-SULHo-aWZk9jAYj_s15vpYTAdFartfJm2zHzd9KIAtBPbKohbML5Aqjt5G-h-7U274lyXCfCtQQaTWkM0 Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:10:35.215364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 504dbd85957345e699eba48ddab99ed2 Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Volume cdda5559-6813-4c48-bf29-b8f9197b1725 could not be found. Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'cdda5559-6813-4c48-bf29-b8f9197b1725'} Jul 26 03:10:35.217038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cdda5559-6813-4c48-bf29-b8f9197b1725 could not be found. (HTTP 404) (Request-ID: req-66511e05-d417-4462-964d-d2abdc6c9bb3) Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.217970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 03:10:35.219326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cdda5559-6813-4c48-bf29-b8f9197b1725 could not be found. Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 03:10:35.220650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cdda5559-6813-4c48-bf29-b8f9197b1725 could not be found. Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cdda5559-6813-4c48-bf29-b8f9197b1725 could not be found. Jul 26 03:10:35.221966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.224007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a26e05dd-3a43-48e4-89df-de9f6ba8aac4 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Returning 404 to user: Volume cdda5559-6813-4c48-bf29-b8f9197b1725 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:10:35.225687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a26e05dd-3a43-48e4-89df-de9f6ba8aac4 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/cdda5559-6813-4c48-bf29-b8f9197b1725" status: 404 len: 109 microversion: 2.1 time: 0.139020 Jul 26 03:10:35.227513 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 7/7] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:10:35 2022] DELETE /compute/v2.1/os-volumes/cdda5559-6813-4c48-bf29-b8f9197b1725 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:10:35.238410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f234eed0-1e5f-46fd-8c38-931ee4285164 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Calling method '.version_select at 0x7f5f7b4458b0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:35.339670 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-f234eed0-1e5f-46fd-8c38-931ee4285164 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] HTTP exception thrown: Volume b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 could not be found. Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f234eed0-1e5f-46fd-8c38-931ee4285164 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Request method failure captured: Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/os-volumes/b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 HTTP/1.1 Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31spm28Go_ou8dKhX0V3NT5eSJ0TeTLc0Zsmk8jpai-CCUwLvbmzu4UXJyN4v2eVpXjT8ZTomHpoVDNiZbhgw9a87yQuW-SULHo-aWZk9jAYj_s15vpYTAdFartfJm2zHzd9KIAtBPbKohbML5Aqjt5G-h-7U274lyXCfCtQQaTWkM0 Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:10:35.342097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc9749de1e594aad9567e9da7e404291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: bc9749de1e594aad9567e9da7e404291 Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-767755769 Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 504dbd85957345e699eba48ddab99ed2 Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-767755769-project Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Volume b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 could not be found. Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'b0f2a6bc-2e78-45b9-87d8-1123b30d37d4'} Jul 26 03:10:35.343651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 could not be found. (HTTP 404) (Request-ID: req-15500cad-d04d-4329-8599-17927ee57456) Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.344585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:10:35.346014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 could not be found. Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 03:10:35.347493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 could not be found. Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 could not be found. Jul 26 03:10:35.348974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:10:35.351674 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f234eed0-1e5f-46fd-8c38-931ee4285164 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] Returning 404 to user: Volume b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:10:35.352873 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f234eed0-1e5f-46fd-8c38-931ee4285164 tempest-VolumesNegativeTest-767755769 tempest-VolumesNegativeTest-767755769-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b0f2a6bc-2e78-45b9-87d8-1123b30d37d4" status: 404 len: 109 microversion: 2.1 time: 0.119322 Jul 26 03:10:35.353598 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 8/8] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:10:35 2022] GET /compute/v2.1/os-volumes/b0f2a6bc-2e78-45b9-87d8-1123b30d37d4 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 03:10:35.649479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4695ec3b-c9d1-4a50-9f4f-c4b2de32c8f0 tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.763773 Jul 26 03:10:35.650120 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 1/9] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Jul 26 03:10:32 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2766 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 03:10:35.667504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c323cd91-ca28-4e1f-b009-c95d89dc1afa tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Calling method '.version_select at 0x7f5f7b510f70>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:35.818988 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c323cd91-ca28-4e1f-b009-c95d89dc1afa tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7" status: 200 len: 352 microversion: 2.1 time: 0.156549 Jul 26 03:10:35.826058 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 9/10] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:10:35 2022] GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7 => generated 352 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:10:36.838128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5086bcf5-1a4e-40b1-8906-8d8f3022201f tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Calling method '.version_select at 0x7f5f7b4af790>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:36.899573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5086bcf5-1a4e-40b1-8906-8d8f3022201f tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7" status: 200 len: 353 microversion: 2.1 time: 0.069265 Jul 26 03:10:36.900934 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 2/11] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:10:36 2022] GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7 => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:10:36.913764 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ab50e415-eda0-44d1-a8ac-23cae258cbcd tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Calling method '.version_select at 0x7f5f7b4453a0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:37.075073 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ab50e415-eda0-44d1-a8ac-23cae258cbcd tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7" status: 200 len: 353 microversion: 2.1 time: 0.165002 Jul 26 03:10:37.075726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 10/12] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:10:36 2022] GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7 => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:10:37.096380 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6110bd0a-283b-4cd3-956e-eb6d48546d03 tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Calling method '.version_select at 0x7f5f7b4afe50>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:37.266177 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6110bd0a-283b-4cd3-956e-eb6d48546d03 tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7" status: 202 len: 0 microversion: 2.1 time: 0.174374 Jul 26 03:10:37.267023 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 3/13] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:10:37 2022] DELETE /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:10:37.275363 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-42b98a44-c214-44f7-8602-5c2a000ab942 tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Calling method '.version_select at 0x7f5f7b4454c0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:37.435787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-42b98a44-c214-44f7-8602-5c2a000ab942 tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7" status: 200 len: 352 microversion: 2.1 time: 0.164685 Jul 26 03:10:37.443026 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 11/14] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:10:37 2022] GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7 => generated 352 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:10:38.449626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52647b2d-b08b-4a92-b66d-91e035bdf09a tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Calling method '.version_select at 0x7f5f7b4c7550>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:38.505185 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-52647b2d-b08b-4a92-b66d-91e035bdf09a tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] HTTP exception thrown: Volume 6337790c-2480-4685-a4e9-a52aa06b05c7 could not be found. Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52647b2d-b08b-4a92-b66d-91e035bdf09a tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Request method failure captured: Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7 HTTP/1.1 Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31so_m4MmSQ1swP7jnH9xxa5z4hygI7H9exLlAvgHpOYM4kqM0LKyWuFO3gAagF9263-txAbQS9jjtEsmwiUcaPSMmmuX7rFXgTo_osYxjrE8i43EJfom-iHwESTB7xWfyNyNULOzeLraife6AfX2xyv2Xubuy1LJOPLD2Wp6nwlbJA Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 742e204cb5d249459352af9a37abfeb4 Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-VolumesGetTestJSON-283350285 Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:10:38.510719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_742e204cb5d249459352af9a37abfeb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/742e204cb5d249459352af9a37abfeb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/742e204cb5d249459352af9a37abfeb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/742e204cb5d249459352af9a37abfeb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-VolumesGetTestJSON-283350285 Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 742e204cb5d249459352af9a37abfeb4 Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-VolumesGetTestJSON-283350285 Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-VolumesGetTestJSON-283350285-project Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 505dc808299b4aed943c1640f145393b Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-VolumesGetTestJSON-283350285-project Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Volume 6337790c-2480-4685-a4e9-a52aa06b05c7 could not be found. Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '6337790c-2480-4685-a4e9-a52aa06b05c7'} Jul 26 03:10:38.511988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6337790c-2480-4685-a4e9-a52aa06b05c7 could not be found. (HTTP 404) (Request-ID: req-d10524df-aa9c-494b-a239-17d1cdc2a446) Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:38.512703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:10:38.513524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6337790c-2480-4685-a4e9-a52aa06b05c7 could not be found. Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 03:10:38.514544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6337790c-2480-4685-a4e9-a52aa06b05c7 could not be found. Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6337790c-2480-4685-a4e9-a52aa06b05c7 could not be found. Jul 26 03:10:38.515388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:10:38.517602 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52647b2d-b08b-4a92-b66d-91e035bdf09a tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] Returning 404 to user: Volume 6337790c-2480-4685-a4e9-a52aa06b05c7 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:10:38.518637 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-52647b2d-b08b-4a92-b66d-91e035bdf09a tempest-VolumesGetTestJSON-283350285 tempest-VolumesGetTestJSON-283350285-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7" status: 404 len: 109 microversion: 2.1 time: 0.072988 Jul 26 03:10:38.519714 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 4/15] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:10:38 2022] GET /compute/v2.1/os-volumes/6337790c-2480-4685-a4e9-a52aa06b05c7 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:10:44.290138 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2007096064", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:44.600819 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] validate_networks() for [('f1a42af0-22f4-4dac-9f7e-d498fada0f45', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:10:46.839864 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:10:46.840437 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:10:46.841490 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:10:46.842014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:10:46.842434 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:10:46.877568 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:46.879816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:46.880959 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:46.881398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:46.945849 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for project a07cd1888316403eb9c37610a310b76d. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:10:46.971860 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for user 1a1125811ba549e0ae66b26ad3949f23 and project a07cd1888316403eb9c37610a310b76d. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:10:47.009292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:10:47.041293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:10:47.211047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-37720ed4-0d83-4c5f-b61b-c600b1649196 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.526456 Jul 26 03:10:47.211699 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 12/16] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:10:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:10:47.213457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a9ba2697-ba19-4e01-8edd-22e1319c8c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'create', calling method: .version_select at 0x7f5f7b4c7f70>, body: {"keypair": {"name": "tempest-keypair-866725568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpnMNPqpv9SenrZE3S1KTdJxNXvwu0nlvGXhrVxtWPgMTfGaE91rs8T248HXtlVMztck0PlePRPjPmml+gJC9h8XfhI8Hxg+kHslkExduR9FBuczDrAqPZqeItPP7/jhQ=="}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:47.224376 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fe8460b4-d0ca-401e-b9f4-42bee46c8a07 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:47.226371 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fe8460b4-d0ca-401e-b9f4-42bee46c8a07 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:47.302139 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-a9ba2697-ba19-4e01-8edd-22e1319c8c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for project ab741435041940cc9c7f02b27120bd90. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:10:47.311461 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-a9ba2697-ba19-4e01-8edd-22e1319c8c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for user 037c9f8229a44de198ebc3752f7a1966 and project ab741435041940cc9c7f02b27120bd90. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:10:47.408860 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fe8460b4-d0ca-401e-b9f4-42bee46c8a07 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:47.429300 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a9ba2697-ba19-4e01-8edd-22e1319c8c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.418443 Jul 26 03:10:47.431286 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 5/17] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Jul 26 03:10:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 421 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 03:10:47.437950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fe8460b4-d0ca-401e-b9f4-42bee46c8a07 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1222 microversion: 2.1 time: 0.217706 Jul 26 03:10:47.448904 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 13/18] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:10:47 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:10:47.617347 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1949199140", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:47.803107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] validate_networks() for [('f1a42af0-22f4-4dac-9f7e-d498fada0f45', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:10:50.065261 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:10:50.066729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:10:50.067558 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:10:50.068119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:10:50.068716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:10:50.087165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:50.088383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:50.090805 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:50.091444 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:50.177848 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for project a07cd1888316403eb9c37610a310b76d. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:10:50.184076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for user 1a1125811ba549e0ae66b26ad3949f23 and project a07cd1888316403eb9c37610a310b76d. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:10:50.206561 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:10:50.212398 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:10:50.343158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-51b6681b-a7ca-4632-a533-c75e6aafbff7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.733333 Jul 26 03:10:50.344649 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 6/19] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:10:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:10:50.358241 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-62204bd2-7c0d-4624-afa9-a874a997eb46 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:50.359371 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-62204bd2-7c0d-4624-afa9-a874a997eb46 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:50.661157 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-62204bd2-7c0d-4624-afa9-a874a997eb46 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:50.676798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-62204bd2-7c0d-4624-afa9-a874a997eb46 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1222 microversion: 2.1 time: 0.323959 Jul 26 03:10:50.678223 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 14/20] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:10:50 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1222 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:10:51.703723 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4e1aa07a-06c4-4b75-b903-e1fb9f0a3b90 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:51.705685 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4e1aa07a-06c4-4b75-b903-e1fb9f0a3b90 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:52.427888 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4e1aa07a-06c4-4b75-b903-e1fb9f0a3b90 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:52.461910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4e1aa07a-06c4-4b75-b903-e1fb9f0a3b90 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1222 microversion: 2.1 time: 0.764289 Jul 26 03:10:52.463060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 7/21] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:10:51 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1222 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:10:52.759226 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1707726031", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4264094-c280-4d22-bc2f-c5a07efc0e99"}], "security_groups": [{"name": "tempest-securitygroup--42717077"}], "key_name": "tempest-keypair-866725568", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:53.432201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] validate_networks() for [('e4264094-c280-4d22-bc2f-c5a07efc0e99', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:10:53.486838 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:53.488355 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:53.500751 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:53.507191 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:53.508366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:53.512111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:54.758037 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:54.777186 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e515f2fa-145c-42ff-bf34-8991b4c6ff7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1282 microversion: 2.1 time: 1.295187 Jul 26 03:10:54.777783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 8/22] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:10:53 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1282 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:10:55.717765 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:10:55.719246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:10:55.719957 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:10:55.720778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:10:55.721608 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:10:55.737248 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:55.745752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:55.747068 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:55.748992 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:55.801248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:55.802519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:55.810846 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for project ab741435041940cc9c7f02b27120bd90. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:10:55.816053 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for user 037c9f8229a44de198ebc3752f7a1966 and project ab741435041940cc9c7f02b27120bd90. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:10:55.820720 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:55.821267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:55.826480 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:55.830547 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:55.861429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:10:55.864003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:10:55.941078 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-14b57794-edf6-47e9-9b2f-7fca085a0bc8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 3.186994 Jul 26 03:10:55.942271 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 15/23] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Jul 26 03:10:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 3189 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 03:10:55.956701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-03bbabf7-2c10-42fa-be64-eb74c241832f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:55.957342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-03bbabf7-2c10-42fa-be64-eb74c241832f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:56.116948 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-03bbabf7-2c10-42fa-be64-eb74c241832f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:56.130152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-03bbabf7-2c10-42fa-be64-eb74c241832f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:56.135467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-03bbabf7-2c10-42fa-be64-eb74c241832f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:56.137124 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-03bbabf7-2c10-42fa-be64-eb74c241832f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1281 microversion: 2.20 time: 0.187309 Jul 26 03:10:56.139255 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 16/24] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:10:55 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:10:56.270911 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:56.284802 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ac55404c-0755-4bc7-89ac-234bfcef4884 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1280 microversion: 2.1 time: 0.488309 Jul 26 03:10:56.299378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 9/25] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:10:55 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1280 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:10:56.741541 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b2c06264-a94c-484e-b9c5-182ec61553fc tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'create', calling method: .version_select at 0x7f5f7a2f2a60>, body: {"keypair": {"name": "tempest-keypair-1961507355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr+KxVTV+4ucFPKs2u9t66G6CSu0RikFl6fDzGdQVRvw1F3jM1t1m1WC9LuFiX6a0Dzfk1wgQt8DN8tyt0H6BbiJ8UIVexWBE5dWlDpYXucOTzBdEzDZP5LFzYPqAdcVQ=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:10:56.765786 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-b2c06264-a94c-484e-b9c5-182ec61553fc tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:10:56.771836 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-b2c06264-a94c-484e-b9c5-182ec61553fc tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for user fbdac72f58df4335b3790c5fb1609f5b and project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:10:56.825260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b2c06264-a94c-484e-b9c5-182ec61553fc tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.361591 Jul 26 03:10:56.826019 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 17/26] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:10:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:10:57.161045 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:57.161667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:57.178497 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:57.186028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:57.198887 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:57.199525 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:57.312440 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:57.313082 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:57.335482 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:57.335929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:57.352228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:57.353291 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:57.600532 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:57.616908 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:57.619924 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:57.629039 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-dc6b4a2a-e639-4137-8abb-75dc92fe17b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1285 microversion: 2.20 time: 0.471846 Jul 26 03:10:57.642976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 10/27] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:10:57 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1285 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:10:58.209508 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:58.257459 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d86c2d56-4e89-49a5-843d-1b0329cd42e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1280 microversion: 2.1 time: 0.949362 Jul 26 03:10:58.273774 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 18/28] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:10:57 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1280 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:10:58.656337 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:58.656952 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:58.666710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:58.668206 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:58.675009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:58.684077 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:59.292356 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:10:59.293147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:10:59.309080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:59.309950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:59.313224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:10:59.315660 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:10:59.503792 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:59.509641 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:59.530149 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4062923d-05df-4f88-9600-bef2f912bd0e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1280 microversion: 2.1 time: 0.241542 Jul 26 03:10:59.530755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 19/29] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:10:59 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:10:59.543873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:59.553876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:10:59.562677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-16c2d559-c642-44af-82a2-6ec3716e38a6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1333 microversion: 2.20 time: 0.910800 Jul 26 03:10:59.564041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 11/30] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:10:58 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1333 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:00.552675 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:00.554339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:00.570743 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:00.573534 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:00.580110 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:00.582814 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:00.592234 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:00.592847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:00.595115 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:00.606439 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:00.606915 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:00.617293 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:00.617813 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:00.982129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:00.999897 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:01.014003 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:01.018459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9c3cb7c8-875f-4b98-a7d0-c2be38361898 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1339 microversion: 2.20 time: 0.428330 Jul 26 03:11:01.019310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 12/31] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:00 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1339 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:11:01.106498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:01.120921 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8d8b7b72-5478-407d-9859-729d49a30cd8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1280 microversion: 2.1 time: 0.571777 Jul 26 03:11:01.121574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 20/32] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:00 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1280 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:02.042274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:02.042995 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:02.064554 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:02.065003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:02.071451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:02.071837 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:02.366162 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-261140751", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "networks": [{"uuid": "e6e6890a-7f6a-43ec-8f2f-9c4e10d8075c"}]}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:02.459708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=12 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:02.478081 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] validate_networks() for [('e6e6890a-7f6a-43ec-8f2f-9c4e10d8075c', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:11:02.819299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:02.832649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:02.834232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:02.850870 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f158d040-67c2-4229-983d-0aa640270b86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.797359 Jul 26 03:11:02.852242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 21/33] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:02 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:11:02.867073 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:02.880525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:02.910203 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:02.911234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:02.917909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:02.923655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:03.501803 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:03.512353 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0461405a-e5c4-4481-aaef-a33f182670c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.658819 Jul 26 03:11:03.526531 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 22/34] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:02 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:03.877183 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:03.877787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:03.884202 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:03.888384 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:03.889749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:03.891276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:04.614907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:04.631518 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:04.646769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:04.652520 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9ce115d2-8ff2-4d67-84b4-d18a32c136db tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.778416 Jul 26 03:11:04.655060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 23/35] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:03 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:04.676693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:04.677484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:04.693630 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:04.694685 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:04.697298 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:04.702207 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:05.187451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:05.197920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-97975168-54cc-469d-a4e8-e39075f7de3a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.538556 Jul 26 03:11:05.214360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 24/36] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:04 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:05.233978 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1924232261", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ee3d40a-6386-40e4-904c-54dd185c894f"}], "security_groups": [{"name": "tempest-securitygroup--555729027"}], "key_name": "tempest-keypair-1961507355", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:05.781990 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:06.252366 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] validate_networks() for [('2ee3d40a-6386-40e4-904c-54dd185c894f', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:11:06.783267 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=22 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:07.550239 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:11:07.550703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:11:07.551288 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:11:07.551698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:11:07.552108 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:11:07.575745 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:07.578326 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:07.581856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:07.582543 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:07.675009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Getting quotas for project e5b0edb065564485bebea31ef6f20b7e. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:11:07.695657 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Getting quotas for user adcae81584cc447db8d2628ff6e1bf5b and project e5b0edb065564485bebea31ef6f20b7e. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:11:07.728592 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:11:07.739455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:11:07.896990 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0955e3e4-fe76-4c6e-8aaf-bc619b2755fd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.911335 Jul 26 03:11:07.917061 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 13/37] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 5932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:11:07.922552 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:07.930632 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:07.959782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:07.960234 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:07.961030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:07.961467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:08.591710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:11:08.592180 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:11:08.592575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:11:08.592977 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:11:08.593710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:11:08.615648 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:08.616365 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:08.617408 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:08.619677 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:08.679262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:11:08.701274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for user fbdac72f58df4335b3790c5fb1609f5b and project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:11:08.733487 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:11:08.737122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:11:08.849080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f240313a-d096-4181-b9a3-1057cb578785 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.633245 Jul 26 03:11:08.855322 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 25/38] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:11:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 3640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:11:08.860687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:08.871954 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:08.890869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:08.891701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:08.892692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:08.893355 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:09.252579 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:09.264952 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:09.268741 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:09.279706 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b6345969-d236-4815-b260-98a8b3faeabb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 1.361218 Jul 26 03:11:09.282541 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 14/39] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:07 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:09.327394 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:09.341906 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d4301c6f-b502-404c-bbdc-c1743c1d3b08 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.484189 Jul 26 03:11:09.343861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 26/40] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:08 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:09.358863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:09.358863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:09.383493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:09.385511 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:09.388480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:09.392448 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:09.619949 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ea3f1a21-d222-4da8-8938-87342f511dbc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: .version_select at 0x7f5f799fdf70>, body: {"keypair": {"name": "tempest-keypair-1872523297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ8SlbLNhN6ZR4IQcRPEhsnPsd5kwTbFCvXiuFtLMPcjuSim9QYK+Q9sbJoT/CWlLhYIRib1RMbkMTiPI7ynMHO9AMN/zZBiT04k318Puk+oaELbHhcJukFEaZT4/LGWA=="}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:09.648977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-ea3f1a21-d222-4da8-8938-87342f511dbc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:11:09.660919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-ea3f1a21-d222-4da8-8938-87342f511dbc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:11:09.686855 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:09.713241 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c244140a-4030-4945-bd07-74e6630fc273 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1218 microversion: 2.1 time: 0.365088 Jul 26 03:11:09.713534 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ea3f1a21-d222-4da8-8938-87342f511dbc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.422215 Jul 26 03:11:09.714754 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 15/41] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:11:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:09.720104 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 27/42] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:09 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1218 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:09.725964 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8f4632f1-8678-4b4d-bebe-f0d0a31d97fd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:09.731330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-8f4632f1-8678-4b4d-bebe-f0d0a31d97fd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:09.825730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-875f0718-8de5-453c-af4c-05c466529fb3 req-da9be243-88bf-446a-a4d8-377377c84236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634ce020-f329-4f42-aca0-d419ac3ba613", "tag": "b87353fe-7737-4250-b95a-0e1027d7987e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:09.850047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-875f0718-8de5-453c-af4c-05c466529fb3 req-da9be243-88bf-446a-a4d8-377377c84236 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:09.850843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-875f0718-8de5-453c-af4c-05c466529fb3 req-da9be243-88bf-446a-a4d8-377377c84236 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:09.880047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-875f0718-8de5-453c-af4c-05c466529fb3 req-da9be243-88bf-446a-a4d8-377377c84236 service nova] Creating event network-changed:b87353fe-7737-4250-b95a-0e1027d7987e for instance 634ce020-f329-4f42-aca0-d419ac3ba613 on hv-cinder-85084 Jul 26 03:11:09.880861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-875f0718-8de5-453c-af4c-05c466529fb3 req-da9be243-88bf-446a-a4d8-377377c84236 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 03:11:09.883199 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ef0c9ac-a1dc-481c-ba29-5d9833cf8cd4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:09.883818 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ef0c9ac-a1dc-481c-ba29-5d9833cf8cd4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:09.885039 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ef0c9ac-a1dc-481c-ba29-5d9833cf8cd4 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:09.886260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ef0c9ac-a1dc-481c-ba29-5d9833cf8cd4 None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:09.899273 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.compute.rpcapi [None req-4ef0c9ac-a1dc-481c-ba29-5d9833cf8cd4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 03:11:09.900952 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ef0c9ac-a1dc-481c-ba29-5d9833cf8cd4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118060) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 03:11:09.942434 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4ef0c9ac-a1dc-481c-ba29-5d9833cf8cd4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220423 Jul 26 03:11:09.945104 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 28/43] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:10.028791 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8f4632f1-8678-4b4d-bebe-f0d0a31d97fd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:10.041023 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8f4632f1-8678-4b4d-bebe-f0d0a31d97fd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1238 microversion: 2.1 time: 0.324851 Jul 26 03:11:10.045681 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 16/44] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:09 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1238 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:10.105097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-49f58e13-3f87-46be-8ffe-ff69098aa747 req-ae034265-29b2-4969-b437-6a694706c955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b2fd31-c308-474f-93fa-f83ffc0cf95f", "tag": "8c749033-d963-446a-8db6-a53a1ffff8ef"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:10.151005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-49f58e13-3f87-46be-8ffe-ff69098aa747 req-ae034265-29b2-4969-b437-6a694706c955 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:10.152346 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-49f58e13-3f87-46be-8ffe-ff69098aa747 req-ae034265-29b2-4969-b437-6a694706c955 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:10.179796 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-49f58e13-3f87-46be-8ffe-ff69098aa747 req-ae034265-29b2-4969-b437-6a694706c955 service nova] Creating event network-changed:8c749033-d963-446a-8db6-a53a1ffff8ef for instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f on hv-cinder-85084 Jul 26 03:11:10.191669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-49f58e13-3f87-46be-8ffe-ff69098aa747 req-ae034265-29b2-4969-b437-6a694706c955 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244255 Jul 26 03:11:10.193056 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 29/45] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:10.313356 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:10.314460 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:10.334401 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:10.354962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:10.356360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:10.356493 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:10.367271 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:10.368488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:10.389496 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:10.391938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:10.392626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:10.395777 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:10.397003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:10.913926 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:10.924776 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2ab600d0-a83b-4406-8f8b-7df345a57916 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.562848 Jul 26 03:11:10.925788 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 30/46] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:10 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:10.947005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:10.948091 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:10.973093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:10.985176 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:10.986244 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:10.988151 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:11.023566 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:11.033004 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:11.054265 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:11.061711 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-121ac80f-2ca4-4cf7-87b5-88f61c55687f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.754138 Jul 26 03:11:11.066181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 17/47] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:10 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:11.074154 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:11.074771 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:11.104895 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:11.105368 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:11.107696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:11.109324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:11.214066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:11.225581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5860d29a-e04c-4147-8063-9646beab81a6 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1218 microversion: 2.1 time: 0.296057 Jul 26 03:11:11.226343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 31/48] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:10 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1218 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:11.340001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:11.349183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0afd65f7-361f-4ed2-b4ea-6c2c021da2ca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1242 microversion: 2.1 time: 0.281806 Jul 26 03:11:11.364833 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 18/49] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:11 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1242 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:11.958089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:11.959487 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:11.979409 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:11.979409 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:11.979409 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:11.979409 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.090509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:12.091520 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:12.105748 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:12.106250 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.107224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:12.107657 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.306180 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:12.315266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:12.316973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:12.320236 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:12.322472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9450b1dd-5c88-42e2-bf6c-c6cc7ca04820 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.235104 Jul 26 03:11:12.323709 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 19/50] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:12 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:12.327178 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-36173c89-4a02-4bcf-9e98-82443e818cda tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.379345 Jul 26 03:11:12.329224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:12.329972 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:12.342939 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 32/51] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:11 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:12.347034 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:12.348120 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.350597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:12.351820 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.354694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-ce9ba73c-8291-4adf-8ec5-0260fac0ed8d req-3164955e-0880-48c7-8f6b-fbc89e37132a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f971d9b5-56d0-41d3-96be-3d84cb6ac42d", "tag": "b6099887-557b-4566-a536-eecde3f944bc"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:12.381681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ce9ba73c-8291-4adf-8ec5-0260fac0ed8d req-3164955e-0880-48c7-8f6b-fbc89e37132a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:12.385496 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ce9ba73c-8291-4adf-8ec5-0260fac0ed8d req-3164955e-0880-48c7-8f6b-fbc89e37132a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.416009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-ce9ba73c-8291-4adf-8ec5-0260fac0ed8d req-3164955e-0880-48c7-8f6b-fbc89e37132a service nova] Creating event network-changed:b6099887-557b-4566-a536-eecde3f944bc for instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d on hv-cinder-85084 Jul 26 03:11:12.428113 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-ce9ba73c-8291-4adf-8ec5-0260fac0ed8d req-3164955e-0880-48c7-8f6b-fbc89e37132a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083503 Jul 26 03:11:12.429127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 33/52] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:12.446609 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:12.450249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:12.473017 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:12.477681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.479831 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:12.481268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:12.695050 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:12.719391 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-67141472-cc98-4b3b-909b-e2be99aac91b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1266 microversion: 2.1 time: 0.394234 Jul 26 03:11:12.720403 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 20/53] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:12 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:12.741219 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:12.751799 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f999d3d9-4661-453b-808b-20670a9122cb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1290 microversion: 2.1 time: 0.321314 Jul 26 03:11:12.752397 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 34/54] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:12 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1290 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:13.355757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:13.356366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:13.360547 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:13.361302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:13.370742 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:13.371390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:13.376498 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:13.377134 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:13.389694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:13.392936 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:13.395415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:13.396908 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:14.084122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:14.093027 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:14.100871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:14.102330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-cf7c763c-64ab-4cfc-a9a1-5c3aaa5b5d4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.756902 Jul 26 03:11:14.103502 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 21/55] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:13 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:14.116093 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:14.116876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:14.128462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:14.131990 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:14.144110 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:14.144913 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:14.241932 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:14.250405 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c1b2ecad-9da5-40fe-b147-f95017d65611 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1272 microversion: 2.1 time: 0.145513 Jul 26 03:11:14.251648 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 22/56] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:14 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:14.267873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:14.268720 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:14.276383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:14.277185 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:14.278147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:14.278876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:14.345076 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:14.353677 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:14.362203 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fbdce726-573e-4c08-a710-77d6ec1d9533 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 1.015637 Jul 26 03:11:14.363881 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 35/57] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:13 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:14.410472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:14.424781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7a98092b-5d12-4a67-bbd9-e1dfbcc776c7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1296 microversion: 2.1 time: 0.170674 Jul 26 03:11:14.426056 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 23/58] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:14 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1296 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:15.037250 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-588340120", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f744be8-1146-4ad7-825e-8d297f751ced"}], "security_groups": [{"name": "tempest-securitygroup--20656343"}], "key_name": "tempest-keypair-1872523297", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:15.133247 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:15.133852 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:15.140162 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.140608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.141379 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.141811 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.151107 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] validate_networks() for [('3f744be8-1146-4ad7-825e-8d297f751ced', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:11:15.287239 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:15.295311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:15.296798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:15.297897 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ee547ede-1df6-451e-a1c3-d91d0891e754 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.168757 Jul 26 03:11:15.298434 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 24/59] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:15 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:11:15.303057 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:15.303866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:15.309677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.310238 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.311008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.311429 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.371872 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:15.379494 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-23da4f81-1dbd-4b65-960e-d4e535ca88bf tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1272 microversion: 2.1 time: 0.080084 Jul 26 03:11:15.380057 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 25/60] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:15 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1272 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:15.384531 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:15.385118 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:15.390921 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.391397 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.392128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.392545 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.534825 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:11:15.535345 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:11:15.535754 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:11:15.536165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:15.536626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:11:15.536626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:11:15.540439 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:15.545492 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-090e7833-244c-4f13-a08b-a0f7499460a0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.164300 Jul 26 03:11:15.546097 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 26/61] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:15 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:15.551060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.551060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.551060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.551060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.551363 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:15.551495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:15.558832 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.559471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.560234 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:15.560670 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:15.567188 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:11:15.571190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:11:15.582814 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:11:15.585137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:11:15.632717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2bee8e4d-f37b-45c3-bb9c-3d6fd95732f8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.603106 Jul 26 03:11:15.640747 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 36/62] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:11:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:11:15.645704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-15a9432b-21f2-46b9-888a-25a8ff33b66a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:15.646492 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-15a9432b-21f2-46b9-888a-25a8ff33b66a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:15.700819 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:15.713558 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-08c21aba-e3b3-4183-b056-9c2fde1ac1d3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.166421 Jul 26 03:11:15.716988 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-15a9432b-21f2-46b9-888a-25a8ff33b66a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:15.719847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 27/63] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:15 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:15.725586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-15a9432b-21f2-46b9-888a-25a8ff33b66a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1241 microversion: 2.1 time: 0.083626 Jul 26 03:11:15.726481 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 37/64] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:15 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:16.324617 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:16.325603 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:16.329204 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:16.333522 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.334016 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.334849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.335363 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.400800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:16.401400 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:16.407993 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.408442 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.409214 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.409648 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.466433 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:16.474049 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:16.475174 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:16.476912 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:16.477997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f8375b59-249d-4dd9-9df0-d14dec2bc2cb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.160280 Jul 26 03:11:16.478725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 28/65] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:16 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:16.486882 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f8d2ab56-49a0-4798-85a9-63657bf2af13 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1272 microversion: 2.1 time: 0.089872 Jul 26 03:11:16.487503 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 38/66] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:16 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:16.567148 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:16.568399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:16.574588 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.575412 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.576423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.577065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.733726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:16.734606 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:16.741754 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.745039 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.747589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.748115 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.903197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:16.913413 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6d5b6f20-faa5-4db1-9404-a3ae96cde644 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.351087 Jul 26 03:11:16.927849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 29/67] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:16 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:16.935502 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:16.936361 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:16.943463 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.944220 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:16.945205 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:16.946045 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:17.010602 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:17.027498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-43c7cd15-ca55-4518-ab7f-6a699ed8d624 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.297520 Jul 26 03:11:17.028652 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 39/68] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:16 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:17.048253 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:17.057542 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-457425f7-a286-45b9-83e7-c0348afa6345 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1293 microversion: 2.1 time: 0.128172 Jul 26 03:11:17.058821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 30/69] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:16 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:17.501425 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:17.503304 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:17.511415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:17.512204 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:17.513630 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:17.514416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:17.526136 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:17.528989 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:17.546044 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:17.548030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:17.549447 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:17.550090 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:17.632982 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:17.691748 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:17.701779 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:17.703681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:17.705001 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-070a83a5-c022-4196-82d4-1b2d0d9f413e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.207633 Jul 26 03:11:17.705705 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 40/70] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:17 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:17.725353 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-a929c255-1a87-40c6-b7c5-6f42aa27c80a req-babff8b4-2e3e-4bc2-9cec-0a1a54fecc5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c517b5ca-379c-4830-bc26-021ce1412c76", "tag": "d86abaff-32bb-4e23-9486-8cfc0e7fcbfa"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:17.727116 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:17.735692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-a929c255-1a87-40c6-b7c5-6f42aa27c80a req-babff8b4-2e3e-4bc2-9cec-0a1a54fecc5f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:17.736240 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0ca0c8ab-490f-40ed-a88b-7652d65e932c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.232033 Jul 26 03:11:17.736348 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-a929c255-1a87-40c6-b7c5-6f42aa27c80a req-babff8b4-2e3e-4bc2-9cec-0a1a54fecc5f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:17.736950 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 31/71] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:17 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:17.748137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-a929c255-1a87-40c6-b7c5-6f42aa27c80a req-babff8b4-2e3e-4bc2-9cec-0a1a54fecc5f service nova] Creating event network-changed:d86abaff-32bb-4e23-9486-8cfc0e7fcbfa for instance c517b5ca-379c-4830-bc26-021ce1412c76 on hv-cinder-85084 Jul 26 03:11:17.753150 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-a929c255-1a87-40c6-b7c5-6f42aa27c80a req-babff8b4-2e3e-4bc2-9cec-0a1a54fecc5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035635 Jul 26 03:11:17.753756 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 41/72] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:17.940994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:17.941594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:17.949829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:17.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:17.951420 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:17.951812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.050370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:18.051643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:18.062575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.067187 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.068336 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.070247 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.282596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:18.292910 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5464d5d4-6c5f-480d-8486-d17ff4bb58de tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.247389 Jul 26 03:11:18.307658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 42/73] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:18 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:18.313363 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:18.313996 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:18.321938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.322555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.323420 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.323904 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.337914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:18.346128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9cb71c43-68c3-49d0-8dd7-b7569162f7ea tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.408872 Jul 26 03:11:18.346717 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 32/74] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:17 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:18.410482 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:18.419449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1c6044b7-5778-4342-8d02-8d0847643a86 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1293 microversion: 2.1 time: 0.110575 Jul 26 03:11:18.420640 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 43/75] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:18 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:18.732213 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:18.732817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:18.740828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.740828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.744750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.745278 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.757251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:18.757861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:18.770384 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.770842 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.771798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:18.772260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:18.952765 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:18.962313 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3371cee7-ba51-41de-ab6b-53f9e67b17d7 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.208844 Jul 26 03:11:18.962901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 44/76] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:18 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:19.001729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:19.011548 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:19.012455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:19.014156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-58e7fc55-0e84-416a-bbfa-e3c8343a8f4a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.285973 Jul 26 03:11:19.014843 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 33/77] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:18 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:19.070052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-be201de6-323c-45ec-b8c0-6b40dc9d7d42 req-9bd654d6-604c-47b2-9da7-0f9dba19d083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081d9334-8b62-466f-b044-b545530fa1af", "tag": "c748a4ff-87ac-4846-94d5-7234a5350eca"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:19.080690 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-be201de6-323c-45ec-b8c0-6b40dc9d7d42 req-9bd654d6-604c-47b2-9da7-0f9dba19d083 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.081272 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-be201de6-323c-45ec-b8c0-6b40dc9d7d42 req-9bd654d6-604c-47b2-9da7-0f9dba19d083 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.093563 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-be201de6-323c-45ec-b8c0-6b40dc9d7d42 req-9bd654d6-604c-47b2-9da7-0f9dba19d083 service nova] Creating event network-changed:c748a4ff-87ac-4846-94d5-7234a5350eca for instance 081d9334-8b62-466f-b044-b545530fa1af on hv-cinder-85084 Jul 26 03:11:19.098408 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-be201de6-323c-45ec-b8c0-6b40dc9d7d42 req-9bd654d6-604c-47b2-9da7-0f9dba19d083 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032173 Jul 26 03:11:19.099180 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 45/78] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:19.323292 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:19.324237 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:19.333259 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.333804 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.334836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.335495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.369214 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:19.370005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:19.376843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.377221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.377989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.378425 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.479560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:19.487832 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3ecb6115-7a0f-4438-96c6-b7974029646c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.171278 Jul 26 03:11:19.488386 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 34/79] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:19 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:19.492966 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:19.493594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:19.499495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.499938 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.500693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.501107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.513234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:19.520768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c781b96c-51aa-4596-aeec-ba825c4b428a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.155823 Jul 26 03:11:19.521351 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 46/80] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:19 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:19.561547 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:19.568923 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-843ef083-7e62-44fd-b3f6-0b476e110e66 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1293 microversion: 2.1 time: 0.079417 Jul 26 03:11:19.569479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 35/81] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:19 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1293 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:19.982649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:19.983351 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:19.990000 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.990449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:19.991240 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:19.991672 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.037361 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:20.037934 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:20.039953 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=12 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:20.045536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.045984 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.046758 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.047238 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.122000 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:20.129707 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a2e17c08-7dbb-42d1-a53b-6ab01352601c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.151053 Jul 26 03:11:20.130242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 47/82] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:19 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:20.178040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:20.186612 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:20.188161 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:20.189264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b67ff5c2-092b-4c33-8e1a-383dd43237d0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.155894 Jul 26 03:11:20.189860 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 36/83] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:20 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:20.512819 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:20.513688 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:20.524063 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.524813 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.526067 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.526781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.541573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:20.542269 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:20.549390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.549872 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.550670 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.551165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.662196 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:20.670269 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cbe00a74-7b04-4e76-93fb-65a560a430a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.163997 Jul 26 03:11:20.670980 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 48/84] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:20 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:20.675662 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:20.676428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:20.682883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.683540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.683935 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:20.684613 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:20.685041 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:20.691757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a23a5845-af38-4a25-b53b-cc110d8bc41a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.154006 Jul 26 03:11:20.692516 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 37/85] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:20 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:20.745471 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:20.753404 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-61a6a702-238b-4921-a0ca-9c8d7e0d28cd tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1293 microversion: 2.1 time: 0.081340 Jul 26 03:11:20.754091 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 49/86] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:20 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:21.150339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:21.150971 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:21.157695 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.158142 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.158900 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.159374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.212586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:21.213504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:21.219932 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.220373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.221248 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.221824 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.296491 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:21.305841 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-88af3517-8359-44a0-8c62-153bb2aa35dd tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.159441 Jul 26 03:11:21.306730 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 38/87] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:21 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:21.358652 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:21.366974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:21.368460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:21.369552 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e8aaa06c-01aa-493f-befd-e03a9c16cb34 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.161341 Jul 26 03:11:21.370381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 50/88] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:21 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:11:21.694829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:21.695448 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:21.702813 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.703635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.704376 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.704796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.714205 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:21.714903 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:21.724758 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.725200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.726163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:21.726553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:21.989035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:22.009322 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0b84bf44-560a-4795-969d-1e4bc5765683 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.299519 Jul 26 03:11:22.010304 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 51/89] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:21 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:22.015057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:22.015621 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:22.023541 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:22.029008 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:22.030063 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:22.030633 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:22.382017 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:22.397033 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-de3eab21-a127-4b2f-bd8f-778eefdbff7b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.707317 Jul 26 03:11:22.397646 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 39/90] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:21 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:22.410399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:22.413014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:22.425840 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:22.426391 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:22.427455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:22.428057 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:22.474669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:22.483549 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-80664cbc-0d06-46b3-b081-05f9ac364142 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1293 microversion: 2.1 time: 0.471354 Jul 26 03:11:22.499771 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 52/91] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:22 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1293 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:22.525527 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:22.526347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:22.533585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:22.534186 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:22.535274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:22.536070 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:22.963781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:22.973639 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-89260153-3b51-4bca-8f06-b988f2a24c85 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.574299 Jul 26 03:11:22.975268 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 40/92] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:22 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:23.030935 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:23.031628 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:23.038488 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:23.039436 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:23.040406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:23.041010 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:23.197874 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:23.207092 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:23.209008 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:23.210388 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-12c25236-e85a-4780-98d0-4a0cdebc133a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.709337 Jul 26 03:11:23.211196 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 53/93] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:22 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:23.268835 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:23.279150 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-56512705-dca5-427b-b058-d716e80575d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.253091 Jul 26 03:11:23.280129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 41/94] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:23 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:23.418849 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:23.419927 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:23.430432 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:23.431051 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:23.431889 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:23.432516 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:23.504165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:23.505448 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:23.513213 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:23.514072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:23.515059 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:23.515682 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:23.598317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:23.608281 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e591900e-93db-4996-8e66-206f600b7f1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1299 microversion: 2.1 time: 0.107732 Jul 26 03:11:23.611594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 42/95] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:23 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:23.816852 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:23.834491 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-255983d8-2487-4deb-bc96-10950d9f4975 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.414051 Jul 26 03:11:23.837871 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 54/96] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:23 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:24.031944 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:24.032602 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:24.050758 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.059929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.061453 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.065479 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.072340 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-64b9cf3f-323c-49cb-8502-dbfdef10cbb0 req-9521d435-dcf3-4df9-890d-b8d0075446bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f971d9b5-56d0-41d3-96be-3d84cb6ac42d", "name": "network-vif-plugged", "status": "completed", "tag": "b6099887-557b-4566-a536-eecde3f944bc"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:24.099226 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:24.105716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-64b9cf3f-323c-49cb-8502-dbfdef10cbb0 req-9521d435-dcf3-4df9-890d-b8d0075446bc service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.106367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-64b9cf3f-323c-49cb-8502-dbfdef10cbb0 req-9521d435-dcf3-4df9-890d-b8d0075446bc service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.156292 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-64b9cf3f-323c-49cb-8502-dbfdef10cbb0 req-9521d435-dcf3-4df9-890d-b8d0075446bc service nova] Creating event network-vif-plugged:b6099887-557b-4566-a536-eecde3f944bc for instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d on hv-cinder-85084 Jul 26 03:11:24.160752 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-64b9cf3f-323c-49cb-8502-dbfdef10cbb0 req-9521d435-dcf3-4df9-890d-b8d0075446bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=118059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 03:11:24.161636 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1696c56f-4d39-4b8e-96b2-00d458ba768f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.162723 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1696c56f-4d39-4b8e-96b2-00d458ba768f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.165515 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1696c56f-4d39-4b8e-96b2-00d458ba768f None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.168869 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1696c56f-4d39-4b8e-96b2-00d458ba768f None None] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.184234 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:24.198159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.compute.rpcapi [None req-1696c56f-4d39-4b8e-96b2-00d458ba768f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 03:11:24.199555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1696c56f-4d39-4b8e-96b2-00d458ba768f None None] Releasing lock "compute-rpcapi-router" {{(pid=118059) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 03:11:24.237828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1696c56f-4d39-4b8e-96b2-00d458ba768f None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292271 Jul 26 03:11:24.239269 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 43/97] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:24.259783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:24.260828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:24.271415 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.272200 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.273132 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.274627 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.685801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:24.694568 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-11fc365a-e8cc-4eaa-8699-904fcbf9d01b tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.698486 Jul 26 03:11:24.695989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 55/98] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:23 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:24.714414 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:24.714710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:24.723577 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.724118 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.724975 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.725481 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.889138 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:24.933696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:24.938229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:24.940228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bb72ba44-9477-473f-8ee7-a6ff1bf88e6b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.696470 Jul 26 03:11:24.941016 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 44/99] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:24 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:24.950124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:24.951576 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:24.968509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.969092 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:24.970006 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:24.970886 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:25.138038 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:25.146343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-cfd5cde1-c799-4be7-a26d-b26b0a4f9ca8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.203980 Jul 26 03:11:25.147129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 45/100] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:24 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:25.159044 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:25.160025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:25.171646 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:25.172217 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:25.173096 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:25.173565 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:25.206704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:25.216395 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-dcfe482b-b520-4862-a802-5db9d09d6cb3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.519130 Jul 26 03:11:25.217302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 56/101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:24 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:25.376620 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:25.386854 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0f59d1c0-8ab9-4f92-bfc2-18b5eba1cf1c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.235617 Jul 26 03:11:25.389413 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 46/102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:25 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:25.718200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:25.719011 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:25.722095 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:25.722780 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=14 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:25.728954 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:25.729638 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:25.730441 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:25.730873 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:25.874454 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:25.882252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ba35e1bd-f4c0-4742-9259-6fc3921ca51a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.169015 Jul 26 03:11:25.883317 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 57/103] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:25 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:25.964240 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:25.965735 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:25.972102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:25.972750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:25.973571 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:25.974145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.172279 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:26.174569 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:26.187849 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.188738 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.189953 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.190757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.510050 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:26.522390 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-208513dd-aeaf-4633-9f49-ad43175422bf tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.358387 Jul 26 03:11:26.523010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 58/104] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:26 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:26.542792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:26.543588 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:26.545640 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:26.552381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.553130 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.554307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.555013 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.574333 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:26.581552 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:26.586520 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c3dbcb3b-22a6-4c02-8345-9bda7e38aa66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.626098 Jul 26 03:11:26.589684 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 47/105] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:25 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:26.597964 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-28cf1e2d-0520-4bce-9a0b-48ef8eed4596 req-931233c0-118e-454f-9e1f-50208a756e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634ce020-f329-4f42-aca0-d419ac3ba613", "name": "network-vif-plugged", "status": "completed", "tag": "b87353fe-7737-4250-b95a-0e1027d7987e"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:26.616311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-28cf1e2d-0520-4bce-9a0b-48ef8eed4596 req-931233c0-118e-454f-9e1f-50208a756e50 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.617190 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-28cf1e2d-0520-4bce-9a0b-48ef8eed4596 req-931233c0-118e-454f-9e1f-50208a756e50 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.694591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-28cf1e2d-0520-4bce-9a0b-48ef8eed4596 req-931233c0-118e-454f-9e1f-50208a756e50 service nova] Creating event network-vif-plugged:b87353fe-7737-4250-b95a-0e1027d7987e for instance 634ce020-f329-4f42-aca0-d419ac3ba613 on hv-cinder-85084 Jul 26 03:11:26.711784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-28cf1e2d-0520-4bce-9a0b-48ef8eed4596 req-931233c0-118e-454f-9e1f-50208a756e50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116888 Jul 26 03:11:26.714829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 48/106] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:26.731449 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:26.734450 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:26.743328 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.743761 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.744969 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.745674 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.855752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:26.869392 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a16ab7f4-744e-402b-bd2a-4e2c6800139f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1322 microversion: 2.1 time: 0.330824 Jul 26 03:11:26.871555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 59/107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:26 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:26.906854 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:26.908022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:26.917625 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.918668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:26.920940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:26.921656 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:27.124200 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:27.142079 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-16289314-afea-4dc9-a568-e2e0d44384af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.425738 Jul 26 03:11:27.149115 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 49/108] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:26 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:27.244974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:27.253262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fbe36091-5bb5-4d82-92b2-1d9297f27455 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.353795 Jul 26 03:11:27.254068 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 60/109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:26 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:27.309759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-79ba001a-207e-4e29-8d04-106855a8e156 req-a1ea7f94-b880-4bda-9865-35acccdc1ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e66410-316a-4d20-a6f8-c248fb10a534", "tag": "65c2f70b-d12f-49c9-8a17-b9a3a5a002cb"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:27.327856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-79ba001a-207e-4e29-8d04-106855a8e156 req-a1ea7f94-b880-4bda-9865-35acccdc1ea2 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:27.330242 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-79ba001a-207e-4e29-8d04-106855a8e156 req-a1ea7f94-b880-4bda-9865-35acccdc1ea2 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:27.352876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-79ba001a-207e-4e29-8d04-106855a8e156 req-a1ea7f94-b880-4bda-9865-35acccdc1ea2 service nova] Creating event network-changed:65c2f70b-d12f-49c9-8a17-b9a3a5a002cb for instance 32e66410-316a-4d20-a6f8-c248fb10a534 on hv-cinder-85084 Jul 26 03:11:27.359630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-79ba001a-207e-4e29-8d04-106855a8e156 req-a1ea7f94-b880-4bda-9865-35acccdc1ea2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053709 Jul 26 03:11:27.364638 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 50/110] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:27.544663 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:27.547524 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:27.563785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:27.564231 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:27.565005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:27.565428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:27.610174 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:27.612280 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:27.624624 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:27.626377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:27.631632 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:27.633291 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:27.966053 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:27.973772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-590c149d-ce2b-4ecd-837e-5a8adcf74359 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.432793 Jul 26 03:11:27.979047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 61/111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:27 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:27.991785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:27.992960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:28.003288 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.005808 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.007877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.014483 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.129069 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:28.140674 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:28.143132 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:28.144794 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5cb95ca1-9657-4be6-8819-e747b0c8a7e2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.539476 Jul 26 03:11:28.145977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 51/112] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:27 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:28.170360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:28.171077 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:28.184056 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.185127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.186465 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.187399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.310166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:28.321134 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f95774d7-51c8-4996-abf7-7a6d97b96a1f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1515 microversion: 2.1 time: 0.343081 Jul 26 03:11:28.339093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 62/113] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:27 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1515 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:28.347496 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:28.348769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:28.356434 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.357264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.358307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.358929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.419414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:28.435921 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5360869e-f27f-4ba4-b9f2-bef34b47e4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.269676 Jul 26 03:11:28.436540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 52/114] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:28 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:28.454808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:28.457308 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:28.463980 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.464588 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.465520 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.466093 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.567133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lazy-loading 'flavor' on Instance uuid f971d9b5-56d0-41d3-96be-3d84cb6ac42d {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:11:28.752138 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f005193d-d6f2-48da-af3b-2da50997091f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d/action" status: 200 len: 32 microversion: 2.1 time: 0.299178 Jul 26 03:11:28.754255 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 53/115] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:11:28 2022] POST /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d/action => generated 32 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:11:28.768499 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:28.771650 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:28.784669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.786070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.787455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:28.788174 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:28.915829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:28.924192 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c23b7fa5-c43b-4e80-a36d-41b1d6e7fcae tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.583210 Jul 26 03:11:28.926383 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 63/116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:28 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:28.998976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:29.000089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:29.009016 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.009817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:29.010734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.011352 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:29.072844 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:29.082821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-00700f31-b99b-4c3c-a745-b040b9a360fd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.322759 Jul 26 03:11:29.083671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 54/117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:28 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:29.171007 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:29.171803 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:29.178520 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.180282 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:29.181146 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.181576 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:29.258610 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:29.270120 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7ec2b67c-ee63-4081-871d-66c0a0350e99 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.277092 Jul 26 03:11:29.270709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 64/118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:28 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:29.402620 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:29.413106 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:29.415151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:29.416253 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-62b09e2c-8919-4c00-90df-dec6ecb3ac36 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.253397 Jul 26 03:11:29.417293 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 55/119] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:29 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:11:29.457146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:29.458024 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:29.464210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.464647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:29.465400 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.465819 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:29.613046 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:29.620974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-03403eec-2fd5-4423-9225-0f1a739ec673 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.168008 Jul 26 03:11:29.621600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 65/120] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:29 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:29.954812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:29.955801 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:29.982028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.982852 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:29.984528 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:29.986276 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.104654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:30.105284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:30.113174 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.113967 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.115368 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.116152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.231727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:30.245989 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-45a17907-5c4b-4708-a76b-28345677c3a0 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.302204 Jul 26 03:11:30.246586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 56/121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:29 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:30.256232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-4295db9b-1290-48ea-bc34-b4553c44560b req-b1a76e3a-fdba-45b2-950b-69f44e6b753a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b2fd31-c308-474f-93fa-f83ffc0cf95f", "name": "network-vif-plugged", "status": "completed", "tag": "8c749033-d963-446a-8db6-a53a1ffff8ef"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:30.267544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-4295db9b-1290-48ea-bc34-b4553c44560b req-b1a76e3a-fdba-45b2-950b-69f44e6b753a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.268217 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-4295db9b-1290-48ea-bc34-b4553c44560b req-b1a76e3a-fdba-45b2-950b-69f44e6b753a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.280519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-4295db9b-1290-48ea-bc34-b4553c44560b req-b1a76e3a-fdba-45b2-950b-69f44e6b753a service nova] Creating event network-vif-plugged:8c749033-d963-446a-8db6-a53a1ffff8ef for instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f on hv-cinder-85084 Jul 26 03:11:30.287768 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-4295db9b-1290-48ea-bc34-b4553c44560b req-b1a76e3a-fdba-45b2-950b-69f44e6b753a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035341 Jul 26 03:11:30.288694 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 57/122] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:30.311581 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:30.313458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:30.321122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.321889 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.322809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.329750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.353813 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:30.363472 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-587d090b-93fe-4b38-8541-30f9b707fbb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.263501 Jul 26 03:11:30.367695 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 66/123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:30 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:30.440744 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:30.441654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:30.453909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.455628 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.456617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.458613 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.594264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:30.613956 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c0e86225-d665-42fb-9879-ff27a12e46a1 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.319841 Jul 26 03:11:30.615657 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 58/124] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:30 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:30.645905 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:30.647195 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:30.667031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.668913 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:30.671679 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:30.673561 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:31.028352 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:31.042585 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-2b3fcbd7-8a33-4728-af2e-09f3c5f2f493 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.403807 Jul 26 03:11:31.044476 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 59/125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:30 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:31.094338 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:31.102395 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:31.104043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:31.105269 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fcfa9a0b-f51c-4fbf-9dbc-d99108e451f0 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1405 microversion: 2.20 time: 0.668891 Jul 26 03:11:31.115662 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 67/126] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:30 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1405 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:11:31.269759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:31.270497 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:31.277232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:31.277876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:31.278812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:31.279354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:31.299563 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:31.388941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:31.389801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:31.396847 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:31.397428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:31.398209 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:31.398595 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:31.415309 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:31.423310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6cfb7d76-ec41-475e-8356-e24fe183102d tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.157420 Jul 26 03:11:31.424091 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 60/127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:31 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:31.534501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:31.543348 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d633f321-4786-46ae-a9d2-6ac3da3ae4e3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.159262 Jul 26 03:11:31.551603 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 68/128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:31 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:31.636619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:31.637126 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:31.644410 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:31.644712 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:31.645462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:31.645884 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:31.797537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:31.805477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fc01e36c-15e3-4789-8e58-546d6267abc0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.173164 Jul 26 03:11:31.806267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 61/129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:31 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:32.064129 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:32.064721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:32.070930 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.071418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.072172 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.072601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.128456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:32.129277 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:32.138199 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.139012 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.139930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.140694 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.303386 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:32.316143 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9f32feab-fbef-401a-99aa-1ea71ccfdb58 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.255787 Jul 26 03:11:32.316882 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 69/130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:32 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:32.330756 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-c94a5540-b7c1-4453-897a-9398c0270c73 req-e2de7263-b49e-49e6-8dbc-de245bffe93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c517b5ca-379c-4830-bc26-021ce1412c76", "name": "network-vif-plugged", "status": "completed", "tag": "d86abaff-32bb-4e23-9486-8cfc0e7fcbfa"}, {"server_uuid": "081d9334-8b62-466f-b044-b545530fa1af", "name": "network-vif-plugged", "status": "completed", "tag": "c748a4ff-87ac-4846-94d5-7234a5350eca"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:32.333442 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:32.343299 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:32.345178 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:32.346366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c84fe5fb-f66f-496a-b2e2-3c93ea9a49d2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1597 microversion: 2.20 time: 0.222192 Jul 26 03:11:32.347510 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 62/131] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:11:32 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1597 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:11:32.357555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c94a5540-b7c1-4453-897a-9398c0270c73 req-e2de7263-b49e-49e6-8dbc-de245bffe93f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.357947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c94a5540-b7c1-4453-897a-9398c0270c73 req-e2de7263-b49e-49e6-8dbc-de245bffe93f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.372227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-172eeb46-824f-4c6f-8694-1218ea1b3245 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:32.372944 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-172eeb46-824f-4c6f-8694-1218ea1b3245 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:32.373539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-c94a5540-b7c1-4453-897a-9398c0270c73 req-e2de7263-b49e-49e6-8dbc-de245bffe93f service nova] Creating event network-vif-plugged:d86abaff-32bb-4e23-9486-8cfc0e7fcbfa for instance c517b5ca-379c-4830-bc26-021ce1412c76 on hv-cinder-85084 Jul 26 03:11:32.374250 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-c94a5540-b7c1-4453-897a-9398c0270c73 req-e2de7263-b49e-49e6-8dbc-de245bffe93f service nova] Creating event network-vif-plugged:c748a4ff-87ac-4846-94d5-7234a5350eca for instance 081d9334-8b62-466f-b044-b545530fa1af on hv-cinder-85084 Jul 26 03:11:32.382347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-c94a5540-b7c1-4453-897a-9398c0270c73 req-e2de7263-b49e-49e6-8dbc-de245bffe93f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056330 Jul 26 03:11:32.383794 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-172eeb46-824f-4c6f-8694-1218ea1b3245 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.384647 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-172eeb46-824f-4c6f-8694-1218ea1b3245 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.385610 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-172eeb46-824f-4c6f-8694-1218ea1b3245 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.386041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-172eeb46-824f-4c6f-8694-1218ea1b3245 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.388391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 70/132] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:32.447151 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:32.447894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:32.451376 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:32.463617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.464246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.466282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.468016 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.558672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-172eeb46-824f-4c6f-8694-1218ea1b3245 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.190399 Jul 26 03:11:32.559330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 63/133] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Jul 26 03:11:32 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:11:32.567150 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:32.567938 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:32.589132 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.591441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.594923 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.597675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.683899 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:32.692763 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f6483954-0e65-4ff6-b20e-c0fa75d29c96 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.252076 Jul 26 03:11:32.693549 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 71/134] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:32 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:32.827887 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:32.828858 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:32.835573 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.836198 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.837104 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:32.837670 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:32.991068 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:32.997002 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:32.997135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:32.999590 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-954e7065-dde2-4384-ba2f-a22cd6a6639f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.175654 Jul 26 03:11:33.000164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 72/135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:32 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:33.003384 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-14486b19-3f49-4269-b570-d38adaaacfb1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.441653 Jul 26 03:11:33.004104 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 64/136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:32 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:33.339540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:33.340202 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:33.348977 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:33.349424 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:33.350195 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:33.350618 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:33.501158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:33.510018 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fb988468-97bf-4b07-abaa-220d42183f60 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.175431 Jul 26 03:11:33.511499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 73/137] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:33 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:33.717630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:33.718856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:33.731296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:33.731757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:33.732631 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:33.733066 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:33.962188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:33.972162 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-05e69526-5e0c-4c27-8cbb-2ccd95340bbb tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.260857 Jul 26 03:11:33.972733 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 65/138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:33 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:34.034541 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:34.035027 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:34.035416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:34.035644 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:34.042778 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:34.042923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:34.043742 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:34.043916 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:34.044874 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:34.045076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:34.045721 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:34.045945 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:34.185394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:34.251282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:34.262555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-18188486-92ea-4099-895a-3177cfe22083 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.232301 Jul 26 03:11:34.263266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 74/139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:34 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:34.277454 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:34.285311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-94c77106-522d-4ec5-b203-3927f0cf3d38 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.255101 Jul 26 03:11:34.286158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 66/140] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:34 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:34.389788 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-66f12d66-6251-49d2-bb3f-35a7320e9d14 req-0ac3854a-63cd-4cd3-9f2b-ed23fff02bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "634ce020-f329-4f42-aca0-d419ac3ba613", "tag": "b87353fe-7737-4250-b95a-0e1027d7987e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:34.402838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-66f12d66-6251-49d2-bb3f-35a7320e9d14 req-0ac3854a-63cd-4cd3-9f2b-ed23fff02bd5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:34.403535 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-66f12d66-6251-49d2-bb3f-35a7320e9d14 req-0ac3854a-63cd-4cd3-9f2b-ed23fff02bd5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:34.416593 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-66f12d66-6251-49d2-bb3f-35a7320e9d14 req-0ac3854a-63cd-4cd3-9f2b-ed23fff02bd5 service nova] Creating event network-changed:b87353fe-7737-4250-b95a-0e1027d7987e for instance 634ce020-f329-4f42-aca0-d419ac3ba613 on hv-cinder-85084 Jul 26 03:11:34.422431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-66f12d66-6251-49d2-bb3f-35a7320e9d14 req-0ac3854a-63cd-4cd3-9f2b-ed23fff02bd5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036863 Jul 26 03:11:34.423137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 75/141] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:34.533370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:34.534268 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:34.540541 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:34.541160 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:34.542089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:34.542819 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:34.726396 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:34.740197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-03efcf8a-3851-4a34-bad9-cbe9108d013f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.211722 Jul 26 03:11:34.741446 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 67/142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:34 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:34.994780 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:34.995513 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:35.005672 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.005874 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:35.006749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.007433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:35.181291 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:35.190384 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e0d97c44-8d98-41c0-9ace-68861bd05eb2 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.200045 Jul 26 03:11:35.191958 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 76/143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:34 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:35.284107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:35.285062 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:35.291771 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.292493 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:35.293492 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.294146 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:35.306182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:35.306841 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:35.314748 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.315704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:35.316752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.317322 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:35.497324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:35.509917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-255566b5-8c4e-441e-94f3-513e0a079102 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.226692 Jul 26 03:11:35.511490 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 68/144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:35 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:35.521976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:35.532212 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8fae8883-7e29-4c30-bc25-9b4055a8bd83 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.229540 Jul 26 03:11:35.533465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 77/145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:35 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:35.761581 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:35.763230 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:35.776469 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.779604 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:35.780498 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:35.784512 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:36.011707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:36.024186 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b80f87d1-acdb-41e2-8635-fd051a6c1524 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.262912 Jul 26 03:11:36.025084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 69/146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:35 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:36.214034 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:36.214648 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:36.222723 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:36.224025 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:36.224969 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:36.226075 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:36.408015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:36.417824 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5f22d6e2-c367-49c9-b88b-8866ff02d612 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1314 microversion: 2.1 time: 0.210055 Jul 26 03:11:36.423782 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 78/147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:36 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:36.532086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:36.533051 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:36.545451 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:36.545873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:36.553838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:36.554648 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:36.558337 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:36.558789 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:36.562899 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:36.563636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:36.567726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:36.568168 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:36.717042 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:36.726760 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-441b1641-003e-4d00-9483-55008fbba719 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.199093 Jul 26 03:11:36.727380 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 70/148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:36 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:36.745050 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:36.754608 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-608d9bb0-7b8e-4b62-af05-68a4dcd6bdcc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.204814 Jul 26 03:11:36.755541 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 79/149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:36 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:37.047931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:37.049137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:37.057121 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.057860 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:37.058861 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.059386 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:37.307124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:37.316264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-cafb02d8-13da-45ec-9a11-fff1850e150f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.272702 Jul 26 03:11:37.327592 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 71/150] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:37 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:37.438831 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:37.440370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:37.454293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.454756 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:37.455729 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.456111 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:37.619622 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:37.638449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5db7827a-c1aa-4109-8060-2a117866c639 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1500 microversion: 2.1 time: 0.203573 Jul 26 03:11:37.643651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 80/151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:37 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1500 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:37.752832 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:37.756242 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:37.775757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:37.776620 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:37.789698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.795958 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.796361 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:37.797140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.797561 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:37.811454 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:37.816010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:37.816470 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:38.225975 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:38.248803 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-568f346d-2a0f-4ef7-90fa-75efa43beec6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.503179 Jul 26 03:11:38.262788 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:38.269619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 72/152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:37 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:38.272116 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-96ede928-a680-416e-bd4d-203985324d32 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.498074 Jul 26 03:11:38.272943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 81/153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:37 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:38.275302 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-61225ed4-5210-4a4b-a9e5-550d058fd65f req-4ee30170-f40d-498a-b966-db01bddce3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e66410-316a-4d20-a6f8-c248fb10a534", "name": "network-vif-plugged", "status": "completed", "tag": "65c2f70b-d12f-49c9-8a17-b9a3a5a002cb"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:38.291930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-61225ed4-5210-4a4b-a9e5-550d058fd65f req-4ee30170-f40d-498a-b966-db01bddce3f8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:38.292667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-61225ed4-5210-4a4b-a9e5-550d058fd65f req-4ee30170-f40d-498a-b966-db01bddce3f8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:38.313085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-61225ed4-5210-4a4b-a9e5-550d058fd65f req-4ee30170-f40d-498a-b966-db01bddce3f8 service nova] Creating event network-vif-plugged:65c2f70b-d12f-49c9-8a17-b9a3a5a002cb for instance 32e66410-316a-4d20-a6f8-c248fb10a534 on hv-cinder-85084 Jul 26 03:11:38.321505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-61225ed4-5210-4a4b-a9e5-550d058fd65f req-4ee30170-f40d-498a-b966-db01bddce3f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049863 Jul 26 03:11:38.322541 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 73/154] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:38.346341 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:38.347003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:38.355270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:38.355980 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:38.356778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:38.357374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:38.538453 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:38.557826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7b007418-e460-4e7d-9763-47fb39d432dd tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1363 microversion: 2.1 time: 0.220330 Jul 26 03:11:38.559424 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 82/155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:38 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:39.256979 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fa12ff4e-0989-44b2-b528-0e93c0865c1a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a51267a7-1ea9-45c2-a311-4ba456b9fb3c"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:39.259397 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fa12ff4e-0989-44b2-b528-0e93c0865c1a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:39.265608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa12ff4e-0989-44b2-b528-0e93c0865c1a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.266248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa12ff4e-0989-44b2-b528-0e93c0865c1a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.267046 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa12ff4e-0989-44b2-b528-0e93c0865c1a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.268303 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa12ff4e-0989-44b2-b528-0e93c0865c1a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.295135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:39.297309 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:39.319353 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.329176 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.331366 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.332184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.576455 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:39.588629 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4e343a10-a968-4403-90e7-4053cba52664 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.314034 Jul 26 03:11:39.590385 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 83/156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:39 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:39.599875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:39.600966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:39.608311 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.609075 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.610136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.611043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.694283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fa12ff4e-0989-44b2-b528-0e93c0865c1a tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "POST /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441916 Jul 26 03:11:39.695699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 74/157] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:11:39 2022] POST /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:39.702312 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:39.703767 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:39.712954 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.713651 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.714740 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.716000 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.805228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:39.813920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-72bd89bd-4210-4c55-95a8-851693e1340d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1365 microversion: 2.1 time: 0.221890 Jul 26 03:11:39.815329 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 84/158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:39 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:39.924013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:39.935942 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e201b5c8-88d7-46f1-86c7-ea6c4b6bfa36 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1548 microversion: 2.1 time: 0.238010 Jul 26 03:11:39.936818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 75/159] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:39 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1548 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:39.959009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c243f1cf-8998-4f86-95c3-1628cd2584f9 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:39.959500 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c243f1cf-8998-4f86-95c3-1628cd2584f9 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:39.965888 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c243f1cf-8998-4f86-95c3-1628cd2584f9 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.966184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c243f1cf-8998-4f86-95c3-1628cd2584f9 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:39.967320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c243f1cf-8998-4f86-95c3-1628cd2584f9 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:39.967939 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c243f1cf-8998-4f86-95c3-1628cd2584f9 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:40.165681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c243f1cf-8998-4f86-95c3-1628cd2584f9 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210824 Jul 26 03:11:40.166254 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 85/160] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:11:39 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:40.611883 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:40.613303 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:40.622023 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:40.623372 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:40.624517 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:40.625351 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:40.841499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:40.845254 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:40.871382 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:40.872041 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:40.873126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:40.875359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:41.028131 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:41.035123 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:41.039233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f7a47bda-fc50-43de-bcd0-ba49c38ac492 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.431476 Jul 26 03:11:41.045159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 76/161] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:40 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:41.096223 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:41.107805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-44805659-77a5-4f99-b0ef-d39a262c616d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1556 microversion: 2.1 time: 0.275380 Jul 26 03:11:41.109023 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 86/162] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:40 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1556 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:41.131657 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c223232e-391a-4f80-a87f-33225876a469 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:41.132399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c223232e-391a-4f80-a87f-33225876a469 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:41.141729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c223232e-391a-4f80-a87f-33225876a469 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:41.142619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c223232e-391a-4f80-a87f-33225876a469 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:41.144314 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c223232e-391a-4f80-a87f-33225876a469 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:41.144818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c223232e-391a-4f80-a87f-33225876a469 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:41.273394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c223232e-391a-4f80-a87f-33225876a469 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145639 Jul 26 03:11:41.274212 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 77/163] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:11:41 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:42.032465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-2f690c95-8229-4b72-928e-74bc38a07418 req-58c04f9a-3372-48bd-a21a-d9bb565d1767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c517b5ca-379c-4830-bc26-021ce1412c76", "tag": "d86abaff-32bb-4e23-9486-8cfc0e7fcbfa"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:42.069222 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:42.070505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:42.082234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2f690c95-8229-4b72-928e-74bc38a07418 req-58c04f9a-3372-48bd-a21a-d9bb565d1767 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:42.082646 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:42.084234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2f690c95-8229-4b72-928e-74bc38a07418 req-58c04f9a-3372-48bd-a21a-d9bb565d1767 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:42.092271 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:42.092981 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:42.099831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:42.100507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:42.146683 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-2f690c95-8229-4b72-928e-74bc38a07418 req-58c04f9a-3372-48bd-a21a-d9bb565d1767 service nova] Creating event network-changed:d86abaff-32bb-4e23-9486-8cfc0e7fcbfa for instance c517b5ca-379c-4830-bc26-021ce1412c76 on hv-cinder-85084 Jul 26 03:11:42.157381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-2f690c95-8229-4b72-928e-74bc38a07418 req-58c04f9a-3372-48bd-a21a-d9bb565d1767 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130945 Jul 26 03:11:42.162832 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 87/164] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:42.462422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:42.479283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c2571933-7e54-4d78-a59d-4df062499361 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.416055 Jul 26 03:11:42.483483 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 78/165] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:42 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:43.508539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:43.509240 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:43.521743 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:43.522262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:43.522986 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:43.525807 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:43.831438 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:43.846001 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-62aa90e8-50f2-4e63-9147-e314438de264 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.341755 Jul 26 03:11:43.846799 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-72d6eae8-f2e0-4a69-bc88-da98c825b480 req-74411bd5-5101-4da4-b2c1-712328c61ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32e66410-316a-4d20-a6f8-c248fb10a534", "tag": "65c2f70b-d12f-49c9-8a17-b9a3a5a002cb"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:43.847374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 88/166] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:43 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:43.858488 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-72d6eae8-f2e0-4a69-bc88-da98c825b480 req-74411bd5-5101-4da4-b2c1-712328c61ba3 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:43.859146 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-72d6eae8-f2e0-4a69-bc88-da98c825b480 req-74411bd5-5101-4da4-b2c1-712328c61ba3 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:43.870624 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-72d6eae8-f2e0-4a69-bc88-da98c825b480 req-74411bd5-5101-4da4-b2c1-712328c61ba3 service nova] Creating event network-changed:65c2f70b-d12f-49c9-8a17-b9a3a5a002cb for instance 32e66410-316a-4d20-a6f8-c248fb10a534 on hv-cinder-85084 Jul 26 03:11:43.876068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-72d6eae8-f2e0-4a69-bc88-da98c825b480 req-74411bd5-5101-4da4-b2c1-712328c61ba3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033296 Jul 26 03:11:43.876757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 79/167] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:44.869081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:44.869657 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:44.881114 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:44.881655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:44.882586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:44.883164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:45.030688 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:45.038488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1d0987ac-c9cb-4c7f-8334-3e7319264f7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.173691 Jul 26 03:11:45.039084 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 89/168] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:44 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:46.061811 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:46.062659 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:46.069152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:46.069596 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:46.071101 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:46.071829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:46.259796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:46.273566 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-82b59e35-9684-479b-99fa-62c2e4bb840e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.216401 Jul 26 03:11:46.275919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 80/169] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:46 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:47.295333 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:47.295980 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:47.307740 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:47.311017 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:47.312612 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:47.314224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:47.534791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:47.542897 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1d76f989-3607-40b1-b54f-38189ef92a58 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.251355 Jul 26 03:11:47.544142 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 90/170] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:47 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:48.565159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:48.565728 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:48.572236 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:48.572667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:48.573421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:48.573842 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:48.706388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:48.714251 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6606cccf-3005-4aff-bcfd-99d6d99f180b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.153025 Jul 26 03:11:48.714818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 81/171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:48 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:49.736440 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:49.736972 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:49.743186 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:49.743634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:49.744373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:49.744802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:49.747411 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:11:49.876055 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:49.884236 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-07b61b67-1c46-4b2d-80b8-0f48e0dfcbb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.151487 Jul 26 03:11:49.884806 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 91/172] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:49 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:50.907733 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:50.908320 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:50.915303 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:50.915749 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:50.916489 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:50.916909 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:51.064566 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:51.072969 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b453b697-4b5e-46d9-87fb-df6d8201cdbf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.170432 Jul 26 03:11:51.073537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 82/173] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:50 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:51.697117 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:51.697813 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:51.705153 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:51.705654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:51.706476 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:51.706981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:51.735803 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:11:51.845270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1647a051-498c-4575-8844-3efb0cf917ee tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "DELETE /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 204 len: 0 microversion: 2.1 time: 0.151645 Jul 26 03:11:51.847433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 92/174] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:11:51 2022] DELETE /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:11:51.856462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:51.857295 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:51.865598 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:51.866076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:51.866965 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:51.867487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:52.016088 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:52.024780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6df44d60-8e18-45e8-8df9-9d50f9a65a48 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1552 microversion: 2.1 time: 0.172442 Jul 26 03:11:52.025342 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 83/175] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:51 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:52.102327 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:52.103818 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:52.110896 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:52.111602 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:52.112443 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:52.113266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:52.250149 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:52.258353 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-932fb8ea-52b7-4e1d-8555-3e65140e0850 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.167688 Jul 26 03:11:52.258924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 93/176] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:52 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:53.045879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:53.046672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:53.053340 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:53.053780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:53.054792 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:53.055248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:53.209981 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:53.219642 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-cfa83a44-3c0f-453c-aaee-d9296737fd2c tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1552 microversion: 2.1 time: 0.177561 Jul 26 03:11:53.220201 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 84/177] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:53 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:53.279895 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:53.280474 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:53.286821 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:53.287172 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:53.287983 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:53.288495 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:53.701814 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:53.710189 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2f1fafb1-675b-49b0-8b55-2ae9c0586b51 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.434295 Jul 26 03:11:53.710782 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 94/178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:53 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:54.242228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:54.242822 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:54.249465 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:54.250186 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:54.250978 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:54.251410 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:54.422052 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:54.430626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-545103fb-6a2d-4732-ae5b-376c4d590fe4 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1552 microversion: 2.1 time: 0.192857 Jul 26 03:11:54.431227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 85/179] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:54 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:54.730738 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:54.731363 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:54.739415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:54.739415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:54.739415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:54.739415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:54.873625 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:54.881385 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c2aec92d-ac32-4555-bfc7-fd0efc8b0076 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.154420 Jul 26 03:11:54.881941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 95/180] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:54 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:55.451147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:55.451753 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:55.459229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:55.459888 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:55.460709 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:55.461158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:55.608846 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:55.629514 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-59f7e3ee-c2df-4e98-99de-0affc7241283 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1552 microversion: 2.1 time: 0.174349 Jul 26 03:11:55.629514 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 86/181] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:55 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:11:55.902257 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:55.902863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:55.909308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:55.909777 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:55.910576 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:55.911034 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:56.053465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:56.064404 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c8b1e103-946f-4b31-8333-8d3b194ab04b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.166073 Jul 26 03:11:56.065121 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 96/182] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:55 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:56.647343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:56.648775 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:56.659767 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:56.660447 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:56.661535 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:56.662472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:56.739235 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:56.755237 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5c839f0e-d1c1-4d34-82b6-9c430cf3a357 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1510 microversion: 2.1 time: 0.115158 Jul 26 03:11:56.756709 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 87/183] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:56 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1510 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:56.839361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-51639f08-b9fd-4f4a-9888-6b523b96fa93 req-9da80f55-a00e-4148-ba18-04085aa9f2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081d9334-8b62-466f-b044-b545530fa1af", "name": "network-vif-deleted", "tag": "c748a4ff-87ac-4846-94d5-7234a5350eca"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:11:56.859983 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-51639f08-b9fd-4f4a-9888-6b523b96fa93 req-9da80f55-a00e-4148-ba18-04085aa9f2b2 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:56.860429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-51639f08-b9fd-4f4a-9888-6b523b96fa93 req-9da80f55-a00e-4148-ba18-04085aa9f2b2 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:56.875485 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-51639f08-b9fd-4f4a-9888-6b523b96fa93 req-9da80f55-a00e-4148-ba18-04085aa9f2b2 service nova] Creating event network-vif-deleted:c748a4ff-87ac-4846-94d5-7234a5350eca for instance 081d9334-8b62-466f-b044-b545530fa1af on hv-cinder-85084 Jul 26 03:11:56.880883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-51639f08-b9fd-4f4a-9888-6b523b96fa93 req-9da80f55-a00e-4148-ba18-04085aa9f2b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045106 Jul 26 03:11:56.882389 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 97/184] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:11:57.085586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:57.086242 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:57.092463 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:57.092973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:57.093719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:57.094144 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:57.230463 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:57.238455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7aa23719-9125-41ef-adf5-9a24eca47eeb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.156720 Jul 26 03:11:57.239040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 88/185] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:57 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:57.777839 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:57.778643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:57.785700 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:57.786351 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:57.786986 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:57.787391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:57.850821 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:57.859405 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-77660694-855a-4348-819e-2b08e7272041 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1345 microversion: 2.1 time: 0.085784 Jul 26 03:11:57.860168 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 98/186] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:57 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:58.264282 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:58.265262 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:58.276351 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:58.277093 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:58.278332 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:58.279104 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:58.424581 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:58.432403 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-91443bb3-709a-4c14-9d77-39d9c741762c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.175360 Jul 26 03:11:58.432956 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 89/187] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:58 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:58.884803 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:58.885747 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:58.896216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:58.896910 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:58.898168 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:58.898866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:58.968424 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:58.976993 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fb95cd72-8c41-477c-b074-af5c2fad7991 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1345 microversion: 2.1 time: 0.098784 Jul 26 03:11:58.977570 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 99/188] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:58 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:11:59.458230 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:11:59.459145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:11:59.470122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:59.470901 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:59.472183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:11:59.472885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:11:59.609912 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:11:59.617881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5c8aceaa-0d97-4f0b-ba41-bf277a4a39cf tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.166800 Jul 26 03:11:59.618425 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 90/189] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:59 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:00.002370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:00.003355 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:00.011552 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:00.011999 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:00.012769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:00.013203 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:00.077147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:00.085988 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2cb5d5b1-7a28-4e91-bd83-bc92d3aa0bc1 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1345 microversion: 2.1 time: 0.088000 Jul 26 03:12:00.086551 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 100/190] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:11:59 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:00.639217 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:00.639873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:00.646526 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:00.646983 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:00.647759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:00.648183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:00.783754 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:00.792634 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f013bf14-4f40-4f73-a34a-a6b3209dff8c tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.157314 Jul 26 03:12:00.793203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 91/191] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:00 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:01.107783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:01.109062 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:01.116591 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:01.117189 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:01.118089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:01.118521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:01.188739 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcae81584cc447db8d2628ff6e1bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b0edb065564485bebea31ef6f20b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:01.197349 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f30d651c-f906-4e40-b50c-3974586ca870 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 200 len: 1345 microversion: 2.1 time: 0.094481 Jul 26 03:12:01.197930 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 101/192] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:01 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:01.813847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:01.814443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:01.821050 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:01.821494 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:01.822240 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:01.822662 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:01.963712 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:01.971780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-63760182-e7f9-4597-8fec-3eed976cd1c1 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.161734 Jul 26 03:12:01.972430 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 92/193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:01 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:02.221675 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:02.222399 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:02.228984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:02.229457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:02.230240 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:02.230635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:02.244576 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] HTTP exception thrown: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Request method failure captured: Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af HTTP/1.1 Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tF3g8YQBxP7FbUkuCgRFaLRBrcBiLSFMVj2f_2HxEp8LQOZP8nIVAcl4MGrNtcS32ZvIkubRB195tngUGtH-vknRAllKlWcwf-3FBDeWgzhnvshNizu6a4qsnuNUV06n8Wq3nLQkmyZ1W19_68k_6SLHVvxAVWn6E7jQpJl3iqz8A Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:12:02.249148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: adcae81584cc447db8d2628ff6e1bf5b Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.250643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '081d9334-8b62-466f-b044-b545530fa1af'} Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:12:02.254834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.257003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.258149 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Returning 404 to user: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:12:02.258149 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-81b98448-4b3e-4396-864a-f3bfbce00ffa tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 404 len: 111 microversion: 2.1 time: 0.032803 Jul 26 03:12:02.258149 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 102/194] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:02 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:12:02.389524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:02.391951 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:02.398661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:02.399139 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:02.399905 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:02.400329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:02.413465 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] HTTP exception thrown: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Request method failure captured: Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af/os-volume_attachments HTTP/1.1 Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tF3g8YQBxP7FbUkuCgRFaLRBrcBiLSFMVj2f_2HxEp8LQOZP8nIVAcl4MGrNtcS32ZvIkubRB195tngUGtH-vknRAllKlWcwf-3FBDeWgzhnvshNizu6a4qsnuNUV06n8Wq3nLQkmyZ1W19_68k_6SLHVvxAVWn6E7jQpJl3iqz8A Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:12:02.417696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: adcae81584cc447db8d2628ff6e1bf5b Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.418893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'server_id': '081d9334-8b62-466f-b044-b545530fa1af'} Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:12:02.419782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:02.420837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:02.421873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Returning 404 to user: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:12:02.421873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-73a90d37-d906-4cee-a0db-343527ffaaf9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034492 Jul 26 03:12:02.421873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 93/195] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:12:02 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:12:02.993127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:02.993907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:02.997372 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:03.001843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:03.002287 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:03.003962 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:03.003962 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:03.136755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:03.144564 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-731bca32-9784-41f6-b8ef-8c6834f9afa6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.155284 Jul 26 03:12:03.145137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 103/196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:02 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:04.170914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:04.171900 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:04.183008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:04.183759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:04.184991 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:04.185694 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:04.320305 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:04.332098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7768389b-65b1-40d0-9a99-a2dedac1f548 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.167893 Jul 26 03:12:04.332679 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 94/197] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:04 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:05.353293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:05.353893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:05.360372 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:05.360815 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:05.361567 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:05.361992 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:05.494020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:05.502907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-adf50442-0170-4d99-83fa-1c1e3126ad0f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.153421 Jul 26 03:12:05.503979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 104/198] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:05 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:05.641168 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1045906840", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:05.696713 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] validate_networks() for None {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:12:05.749168 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:05.749651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:05.756066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:05.756835 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:05.757753 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:05.758164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:05.773514 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] HTTP exception thrown: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Request method failure captured: Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af HTTP/1.1 Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tF3g8YQBxP7FbUkuCgRFaLRBrcBiLSFMVj2f_2HxEp8LQOZP8nIVAcl4MGrNtcS32ZvIkubRB195tngUGtH-vknRAllKlWcwf-3FBDeWgzhnvshNizu6a4qsnuNUV06n8Wq3nLQkmyZ1W19_68k_6SLHVvxAVWn6E7jQpJl3iqz8A Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:12:05.775359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: adcae81584cc447db8d2628ff6e1bf5b Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.776501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '081d9334-8b62-466f-b044-b545530fa1af'} Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:12:05.777152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.778147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.780776 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Returning 404 to user: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:12:05.781866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-25dc2d7e-86ae-4a0e-9c18-370d7e658fe9 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "DELETE /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 404 len: 111 microversion: 2.1 time: 0.036579 Jul 26 03:12:05.785846 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 105/199] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:12:05 2022] DELETE /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 03:12:05.791098 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:05.792315 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] [instance: 081d9334-8b62-466f-b044-b545530fa1af] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:05.800410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:05.801125 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:05.802636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:05.803193 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:05.818701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] HTTP exception thrown: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Request method failure captured: Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af HTTP/1.1 Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tF3g8YQBxP7FbUkuCgRFaLRBrcBiLSFMVj2f_2HxEp8LQOZP8nIVAcl4MGrNtcS32ZvIkubRB195tngUGtH-vknRAllKlWcwf-3FBDeWgzhnvshNizu6a4qsnuNUV06n8Wq3nLQkmyZ1W19_68k_6SLHVvxAVWn6E7jQpJl3iqz8A Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:12:05.820347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5b0edb065564485bebea31ef6f20b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: e5b0edb065564485bebea31ef6f20b7e Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-DeleteServersTestJSON-144739974 Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: adcae81584cc447db8d2628ff6e1bf5b Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-DeleteServersTestJSON-144739974-project Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.821760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '081d9334-8b62-466f-b044-b545530fa1af'} Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:12:05.822785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. Jul 26 03:12:05.823877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:05.824801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] Returning 404 to user: Instance 081d9334-8b62-466f-b044-b545530fa1af could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:12:05.824801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-981f1636-f175-416b-8beb-d53479269c67 tempest-DeleteServersTestJSON-144739974 tempest-DeleteServersTestJSON-144739974-project] 10.222.0.42 "GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af" status: 404 len: 111 microversion: 2.1 time: 0.036189 Jul 26 03:12:05.824801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 106/200] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:05 2022] GET /compute/v2.1/servers/081d9334-8b62-466f-b044-b545530fa1af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:12:06.120121 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:12:06.120538 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:12:06.121009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:12:06.121404 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:12:06.122184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:12:06.131773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:06.132434 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:06.133378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:06.134130 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:06.146627 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:06.157516 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Getting quotas for project 3c8d6492e3aa4191bf1554213bb749e9. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:12:06.162066 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Getting quotas for user f35bffdd694f4df7befe85d401191ff0 and project 3c8d6492e3aa4191bf1554213bb749e9. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:12:06.174108 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:12:06.177134 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:12:06.228945 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-65529770-8b9c-44d9-ac7b-4fcfe4efd5f6 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591732 Jul 26 03:12:06.231353 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 95/201] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:12:06.243360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-18f2ee3d-7c60-4f29-8237-b5e0f9d410ea tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:06.244229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-18f2ee3d-7c60-4f29-8237-b5e0f9d410ea tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:06.311085 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-18f2ee3d-7c60-4f29-8237-b5e0f9d410ea tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:06.317812 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-18f2ee3d-7c60-4f29-8237-b5e0f9d410ea tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1215 microversion: 2.1 time: 0.079609 Jul 26 03:12:06.318857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 107/202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:06 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:06.524946 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:06.525560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:06.533290 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:06.534035 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:06.535001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:06.535643 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:06.891948 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:06.900467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-add2f287-1de5-4e9e-bd38-e808923489dd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.379521 Jul 26 03:12:06.901047 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 96/203] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:06 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:07.341313 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:07.341910 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:07.353282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:07.353940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:07.354892 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:07.355516 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:07.474624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:07.483598 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-097c4ce7-fd93-45ca-95ef-37162354dcf2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1211 microversion: 2.1 time: 0.146391 Jul 26 03:12:07.484162 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 108/204] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:07 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:07.922869 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:07.924290 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:07.935137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:07.935583 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:07.936373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:07.937784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:08.328459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:08.338771 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ff51029b-8042-4417-ac64-f41e8de486bb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.420625 Jul 26 03:12:08.339367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 97/205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:07 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:08.508826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:08.511256 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:08.531481 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:08.531937 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:08.532809 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:08.533283 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:08.653245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:08.660387 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:08.664416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-62abdf59-ab70-4073-8a05-87e68b9500b1 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1275 microversion: 2.1 time: 0.161364 Jul 26 03:12:08.669383 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 109/206] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:08 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1275 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:09.362650 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:09.363314 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:09.370152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:09.370591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:09.377107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:09.377845 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:09.610327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:09.620104 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-86d4a4bc-7b28-436b-984c-37e763780f10 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1521 microversion: 2.1 time: 0.261234 Jul 26 03:12:09.621312 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 98/207] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:09 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:09.691993 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:09.697109 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:09.708514 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:09.709864 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:09.711032 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:09.711698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:09.808416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:09.822498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-85d5f632-0bb3-4f15-9233-15e0fbbe0262 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1273 microversion: 2.1 time: 0.140373 Jul 26 03:12:09.826394 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 110/208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:09 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:10.649996 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:10.650642 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:10.657188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:10.657840 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:10.658615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:10.659075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:10.819124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:10.828835 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0380acfb-09a8-4ec4-8d06-bf0ed92f8e91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1501 microversion: 2.1 time: 0.189501 Jul 26 03:12:10.830058 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 99/209] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:10 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:10.851493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:10.852092 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:10.868395 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:10.869896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:10.870307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:10.871225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:10.872268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:10.875235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:10.892429 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:10.892890 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:10.893654 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:10.897152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:11.130082 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:11.141571 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-83e787fb-c782-4b5a-968a-2c9236e94e3e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1516 microversion: 2.1 time: 0.284030 Jul 26 03:12:11.143048 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 100/210] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:10 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:11.225223 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:11.236196 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0f08639-63f0-41e4-a498-747d3aff2bf9 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1315 microversion: 2.1 time: 0.391743 Jul 26 03:12:11.237764 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 111/211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:10 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:11.325453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-ef1c4c47-329f-4b5a-b564-290c620fbddd req-28902ac7-5c53-4ba7-9bed-ed51f324eb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d48af69-2dfa-4360-bfd5-cd9e6fce3e53", "tag": "963d1f38-b14b-4c8a-a863-4d1cd98e043c"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:11.350317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-ef1c4c47-329f-4b5a-b564-290c620fbddd req-28902ac7-5c53-4ba7-9bed-ed51f324eb1d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:11.350850 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-ef1c4c47-329f-4b5a-b564-290c620fbddd req-28902ac7-5c53-4ba7-9bed-ed51f324eb1d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:11.368108 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-ef1c4c47-329f-4b5a-b564-290c620fbddd req-28902ac7-5c53-4ba7-9bed-ed51f324eb1d service nova] Creating event network-changed:963d1f38-b14b-4c8a-a863-4d1cd98e043c for instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 on hv-cinder-85084 Jul 26 03:12:11.373787 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-ef1c4c47-329f-4b5a-b564-290c620fbddd req-28902ac7-5c53-4ba7-9bed-ed51f324eb1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051921 Jul 26 03:12:11.374930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 101/212] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:12.262554 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:12.272962 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:12.286408 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:12.287399 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:12.288723 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:12.289391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:12.682242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:12.690487 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e7ae2731-fdde-4bae-b9be-1424c5cc4955 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1315 microversion: 2.1 time: 0.437387 Jul 26 03:12:12.691249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 112/213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:12 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:12.704398 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:12.706720 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:12.709341 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:12.714800 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:12.715273 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:12.716030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:12.716458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:12.741229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lazy-loading 'flavor' on Instance uuid 19b2fd31-c308-474f-93fa-f83ffc0cf95f {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:12:12.819407 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-12623b32-83f4-438c-b18b-ef402293be65 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f/action" status: 200 len: 32 microversion: 2.1 time: 0.119638 Jul 26 03:12:12.820203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 102/214] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:12:12 2022] POST /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:12:12.829946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:12.830688 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:12.837339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:12.838047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:12.839061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:12.839687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:12.978001 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:12.985668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-13dd7c3e-46bf-486a-97fa-1ab5f92dbcbd tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.159851 Jul 26 03:12:12.986244 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 113/215] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:12 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:13.713777 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:13.714566 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:13.723077 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:13.723550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:13.725707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:13.726459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:13.920728 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:13.928756 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b17f0718-e736-4198-8e85-1877be2f98f5 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1315 microversion: 2.1 time: 0.220125 Jul 26 03:12:13.929326 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 103/216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:13 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:14.007297 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:14.007870 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:14.013930 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:14.014490 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:14.015522 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:14.015945 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:14.156712 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:14.164264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-582d254e-1d17-44a8-80fc-65014a0c5d37 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.160952 Jul 26 03:12:14.164824 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 114/217] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:14 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:14.950274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:14.950857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:14.957887 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:14.958327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:14.959197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:14.959625 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:15.094184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:15.102165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a9a8c2c6-7512-421c-8413-49d267ec3792 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1315 microversion: 2.1 time: 0.156357 Jul 26 03:12:15.102745 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 104/218] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:14 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:15.185456 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:15.186262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:15.192903 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:15.193810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:15.194610 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:15.195065 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:15.347098 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:15.360084 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-341d520c-283c-4b26-b37e-ab2a9e98bbae tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.177563 Jul 26 03:12:15.360754 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 115/219] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:15 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:16.127270 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:16.128244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:16.136253 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:16.136699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:16.137508 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:16.137871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:16.152585 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:16.170844 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=6 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:16.271726 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:16.279492 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4b7b068e-9179-4f7e-9e9a-cca752c148f8 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1315 microversion: 2.1 time: 0.158810 Jul 26 03:12:16.280068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 105/220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:16 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:16.381306 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:16.381881 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:16.383832 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:16.389833 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:16.390266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:16.391059 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:16.391491 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:16.522567 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:16.530132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5e369762-1470-492f-bc15-ce5e3319d4d2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.152749 Jul 26 03:12:16.530699 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 116/221] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:16 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:16.849093 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-5fd945e7-97b9-484e-ad84-81a890a6341e req-cff3cc37-e953-42cb-85b1-24fe6ae2de25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d48af69-2dfa-4360-bfd5-cd9e6fce3e53", "name": "network-vif-plugged", "status": "completed", "tag": "963d1f38-b14b-4c8a-a863-4d1cd98e043c"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:16.858879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-5fd945e7-97b9-484e-ad84-81a890a6341e req-cff3cc37-e953-42cb-85b1-24fe6ae2de25 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:16.859369 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-5fd945e7-97b9-484e-ad84-81a890a6341e req-cff3cc37-e953-42cb-85b1-24fe6ae2de25 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:16.871829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-5fd945e7-97b9-484e-ad84-81a890a6341e req-cff3cc37-e953-42cb-85b1-24fe6ae2de25 service nova] Creating event network-vif-plugged:963d1f38-b14b-4c8a-a863-4d1cd98e043c for instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 on hv-cinder-85084 Jul 26 03:12:16.877551 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-5fd945e7-97b9-484e-ad84-81a890a6341e req-cff3cc37-e953-42cb-85b1-24fe6ae2de25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031917 Jul 26 03:12:16.878429 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 106/222] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:17.300394 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:17.301029 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:17.307296 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:17.307744 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:17.308508 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:17.308934 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:17.445587 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:17.453698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f5e85f72-b05d-4f5a-b8c9-a7b4aea213e4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1315 microversion: 2.1 time: 0.157161 Jul 26 03:12:17.454287 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 117/223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:17 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:17.557185 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:17.558368 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:17.569017 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:17.569797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:17.571095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:17.571826 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:17.703152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:17.713835 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6f901f07-94f4-4531-b34b-ecc2ea68fd96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.164487 Jul 26 03:12:17.714407 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 107/224] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:17 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:18.473667 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:18.474277 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:18.480787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:18.481219 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:18.482028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:18.482400 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:18.610110 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:18.617580 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2f89b25a-5157-4e92-9fda-a4ad2d1d0937 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1315 microversion: 2.1 time: 0.147750 Jul 26 03:12:18.618144 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 118/225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:18 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:18.739366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:18.740197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:18.748523 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:18.748963 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:18.749746 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:18.750170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:18.883325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:18.891075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4f00783f-1ef6-4547-b9f0-24b9ce251c2f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.158306 Jul 26 03:12:18.891637 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 108/226] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:18 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:19.637506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:19.638100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:19.644166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.644621 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.645473 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.645898 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.781873 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:19.789697 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4c703a33-92f1-4abd-90d0-ebcbc0a489a2 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1463 microversion: 2.1 time: 0.156060 Jul 26 03:12:19.790461 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 119/227] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:19 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:19.836220 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:19.836782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:19.843548 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.844004 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.844737 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.845136 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.873773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:12:19.912447 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:19.913187 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:19.920477 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.921137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.922066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.922498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.969351 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c4ccdf51-4999-46b3-8c1f-e6831fbc6a04 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 204 len: 0 microversion: 2.1 time: 0.136760 Jul 26 03:12:19.973457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 109/228] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:12:19 2022] DELETE /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:12:19.979762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:19.980588 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:19.988774 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.989171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.989990 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:19.990416 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:19.995982 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:20.081661 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:20.090152 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-76570ab0-7662-4102-8212-bc895dc2d000 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.181672 Jul 26 03:12:20.100709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 120/229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:19 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:20.165088 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:20.174266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-97982168-6d51-45f4-b3f3-b0e5d2185674 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1469 microversion: 2.1 time: 0.199449 Jul 26 03:12:20.174848 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 110/230] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:19 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:21.111600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:21.112228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:21.118466 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:21.118907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:21.119761 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:21.120191 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:21.196311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:21.197034 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:21.204193 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:21.204615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:21.205390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:21.205811 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:21.257701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:21.266106 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-52c67eb2-5f9f-48b8-b468-89550ca045ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.158542 Jul 26 03:12:21.271119 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 121/231] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:21 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:21.347639 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:21.355750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-2e815cd7-6a77-4df7-94c6-54b7072962b0 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1469 microversion: 2.1 time: 0.163256 Jul 26 03:12:21.356340 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 111/232] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:21 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:22.197194 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-8b35f1d0-666a-4c58-ba43-19e685eaaf72 req-133f910b-1fa5-42a4-b0b3-33c34a7dc5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d48af69-2dfa-4360-bfd5-cd9e6fce3e53", "name": "network-vif-deleted", "tag": "963d1f38-b14b-4c8a-a863-4d1cd98e043c"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:22.208157 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-8b35f1d0-666a-4c58-ba43-19e685eaaf72 req-133f910b-1fa5-42a4-b0b3-33c34a7dc5bc service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:22.208594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-8b35f1d0-666a-4c58-ba43-19e685eaaf72 req-133f910b-1fa5-42a4-b0b3-33c34a7dc5bc service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:22.221305 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-8b35f1d0-666a-4c58-ba43-19e685eaaf72 req-133f910b-1fa5-42a4-b0b3-33c34a7dc5bc service nova] Creating event network-vif-deleted:963d1f38-b14b-4c8a-a863-4d1cd98e043c for instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 on hv-cinder-85084 Jul 26 03:12:22.227519 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-8b35f1d0-666a-4c58-ba43-19e685eaaf72 req-133f910b-1fa5-42a4-b0b3-33c34a7dc5bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033874 Jul 26 03:12:22.232359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 122/233] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:22.288323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:22.289033 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:22.296070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:22.296804 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:22.297849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:22.298337 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:22.379725 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:22.380368 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:22.396922 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:22.400902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:22.401586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:22.402028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:22.441049 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:22.441663 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:22.442818 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lazy-loading 'fault' on Instance uuid 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:12:22.443986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:22.453401 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-501d7d6b-e5aa-44dd-8d36-eb8d0a9a5ca4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.169049 Jul 26 03:12:22.463773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 112/234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:22 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:22.488252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f35bffdd694f4df7befe85d401191ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8d6492e3aa4191bf1554213bb749e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:22.496083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0652f82d-0192-42ac-ba9f-fd9f290994b4 tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 200 len: 1305 microversion: 2.1 time: 0.121913 Jul 26 03:12:22.496987 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 123/235] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:22 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 1305 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:23.475558 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:23.476195 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:23.483106 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:23.483664 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:23.484551 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:23.485084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:23.517793 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:23.518967 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] [instance: 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:23.525732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:23.526237 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:23.527021 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:23.527670 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:23.541986 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] HTTP exception thrown: Instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 could not be found. Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Request method failure captured: Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 HTTP/1.1 Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31uC8la-e0dP7-RTwViakockRn3fxbsw2Oj8iNpBIzzV4R7Y28Yrl5RKCrrTW0ztEjAVtun1jzYzIa0jK4g2xI-plfAxX8Z6Ed9ahTtRsVjCci2cQHodUe0TWqwH1tPMXKucGyVWqHe4utPZegPIims6SThtdvmXmiN54HCM3m9P1W0 Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 3c8d6492e3aa4191bf1554213bb749e9 Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesNegativeTest-1365958129 Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:12:23.543669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c8d6492e3aa4191bf1554213bb749e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c8d6492e3aa4191bf1554213bb749e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c8d6492e3aa4191bf1554213bb749e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c8d6492e3aa4191bf1554213bb749e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesNegativeTest-1365958129 Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 3c8d6492e3aa4191bf1554213bb749e9 Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesNegativeTest-1365958129 Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesNegativeTest-1365958129-project Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: f35bffdd694f4df7befe85d401191ff0 Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesNegativeTest-1365958129-project Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 could not be found. Jul 26 03:12:23.545132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '7d48af69-2dfa-4360-bfd5-cd9e6fce3e53'} Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 could not be found. Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:12:23.546010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 could not be found. Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 could not be found. Jul 26 03:12:23.547410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:12:23.548676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] Returning 404 to user: Instance 7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:12:23.548676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ee778d4e-8bd0-475d-aed1-faedebb66e3d tempest-VolumesNegativeTest-1365958129 tempest-VolumesNegativeTest-1365958129-project] 10.222.0.42 "GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53" status: 404 len: 111 microversion: 2.1 time: 0.031355 Jul 26 03:12:23.553417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 124/236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:23 2022] GET /compute/v2.1/servers/7d48af69-2dfa-4360-bfd5-cd9e6fce3e53 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:12:23.666671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:23.674310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-137bf238-33e4-49f6-89db-80da19ab203b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.202551 Jul 26 03:12:23.675417 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 113/237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:23 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:24.695718 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:24.696999 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:24.703864 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:24.704663 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:24.706210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:24.706852 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:24.867433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:24.879275 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fc8c4efa-d79a-467f-ac26-77c5c400c322 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.187326 Jul 26 03:12:24.880006 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 125/238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:24 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:25.901698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:25.902296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:25.908889 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:25.909358 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:25.910275 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:25.910700 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:26.060929 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:26.072592 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-94f46e2c-d3c0-413c-ae93-2fddf57dae14 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.174576 Jul 26 03:12:26.073056 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 114/239] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:25 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:27.095727 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:27.096442 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:27.103278 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.103723 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.104513 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.104938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.320530 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:27.338146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8dc6ca02-715d-4b07-85b8-6407238fcb56 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1502 microversion: 2.1 time: 0.246767 Jul 26 03:12:27.339354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 126/240] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:27 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:27.360101 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54335be7-73e8-4de2-b98d-42c97e9c32aa"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:27.362499 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:27.370076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.370732 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.371690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.372115 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.411786 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] HTTP exception thrown: Cannot 'attach_volume' instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f while it is in vm_state rescued Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Request method failure captured: Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: POST /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f/os-volume_attachments HTTP/1.1 Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 74 Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31szcB1UDzQ9ihgT3Wm9ngfiYKq9a8Wjpdg0C8yLdhowMTHw1KbffvbYec_leHviylPxQox_uESlrlvdkNnUYoB4GAXZ6lVVXK1vzbkNpo96jnHure3qgNMXaWEm_C0Nw7ZW3vrnpESEfAaexI4TmG5RdUjWyOO7anPohn0GnayjLe4 Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:12:27.413485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 1a1125811ba549e0ae66b26ad3949f23 Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {"volumeAttachment": {"volumeId": "54335be7-73e8-4de2-b98d-42c97e9c32aa"}} Jul 26 03:12:27.414917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Cannot 'attach_volume' instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f while it is in vm_state rescued Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'server_id': '19b2fd31-c308-474f-93fa-f83ffc0cf95f', 'body': {'volumeAttachment': {'volumeId': '54335be7-73e8-4de2-b98d-42c97e9c32aa'}}} Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:12:27.416137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f while it is in vm_state rescued Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:12:27.417540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:12:27.418734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:12:27.418734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:12:27.418734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f while it is in vm_state rescued Jul 26 03:12:27.418734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:12:27.418734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Returning 409 to user: Cannot 'attach_volume' instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f while it is in vm_state rescued {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:12:27.418734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4c21e710-7bd7-46fc-9313-0dd7da0d99a8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060567 Jul 26 03:12:27.418734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 115/241] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:12:27 2022] POST /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f/os-volume_attachments => generated 152 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 03:12:27.428225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5e545713-f574-4897-b79f-509d934da4aa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:27.428751 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5e545713-f574-4897-b79f-509d934da4aa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:27.435725 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e545713-f574-4897-b79f-509d934da4aa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.436147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e545713-f574-4897-b79f-509d934da4aa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.437337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e545713-f574-4897-b79f-509d934da4aa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.437626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e545713-f574-4897-b79f-509d934da4aa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.452647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:27.509893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5e545713-f574-4897-b79f-509d934da4aa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f/action" status: 202 len: 0 microversion: 2.1 time: 0.085342 Jul 26 03:12:27.513548 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 127/242] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:12:27 2022] POST /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:12:27.518904 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:27.519708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:27.526208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.526882 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.527664 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:27.528251 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:27.860170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:27.869945 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-56ebdf26-2af4-4f77-8f91-91f6531ef0c6 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1510 microversion: 2.1 time: 0.355049 Jul 26 03:12:27.879019 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 116/243] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:27 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:28.905590 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:28.907895 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:28.917429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:28.918239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:28.919210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:28.921114 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:29.095771 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:29.104723 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9fb25ac6-d608-4bd8-9580-23d2d2c5951f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1510 microversion: 2.1 time: 0.206124 Jul 26 03:12:29.106015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 128/244] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:28 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:30.126255 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:30.126846 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:30.134300 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:30.134739 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:30.135707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:30.136155 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:30.263635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:30.271566 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4904b631-fa1c-4702-bb9e-ea6196913c50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1510 microversion: 2.1 time: 0.149453 Jul 26 03:12:30.272130 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 117/245] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:30 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:30.558155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1c6cc288-d690-4698-a271-135042b7463d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:30.558671 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c6cc288-d690-4698-a271-135042b7463d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:30.565077 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6cc288-d690-4698-a271-135042b7463d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:30.565813 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6cc288-d690-4698-a271-135042b7463d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:30.566591 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6cc288-d690-4698-a271-135042b7463d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:30.567054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c6cc288-d690-4698-a271-135042b7463d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:30.592673 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1c6cc288-d690-4698-a271-135042b7463d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/ips" status: 200 len: 152 microversion: 2.20 time: 0.038515 Jul 26 03:12:30.593286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 129/246] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Jul 26 03:12:30 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:12:31.293388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:31.294803 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:31.302143 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:31.303545 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:31.304549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:31.305332 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:31.555702 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:31.564389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d2433149-0f7c-43ff-90a1-6bcb2a56029d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1516 microversion: 2.1 time: 0.275041 Jul 26 03:12:31.564896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 118/247] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:31 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1516 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:34.671218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:34.672334 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:34.678319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=58 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:34.680275 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:34.681061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:34.681989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:34.682568 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:34.708035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lazy-loading 'flavor' on Instance uuid 634ce020-f329-4f42-aca0-d419ac3ba613 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:12:34.941877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-911b8aa1-a3d0-4d15-bd67-7a1a5800b2ba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/action" status: 202 len: 0 microversion: 2.20 time: 0.274292 Jul 26 03:12:34.942691 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 130/248] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Jul 26 03:12:34 2022] POST /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:12:34.950672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:34.955359 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:34.963975 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:34.964425 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:34.965198 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:34.965630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:35.175208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:35.186748 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:35.188890 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:35.190157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d3ccbb9f-87b6-4c60-98b0-fb6837840707 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.243604 Jul 26 03:12:35.190725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 119/249] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:34 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:35.288839 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ca32d32a-caab-4728-be3e-995e1840e822 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'create', calling method: .version_select at 0x7f5f7981f550>, body: {"keypair": {"name": "tempest-keypair-1958253522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLIePofoF+H/KWpVEoMwih3LSiFM8ArtWAqKsrhH6HyJAawyC7DRxTXKFcHn6SV5B5TovOp4dpd964Bvvzdif7mvGl4ldVgI5dUdTcpS6Yxou5+vFq5tpq+t4RaeLpckQ=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:35.333865 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-ca32d32a-caab-4728-be3e-995e1840e822 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for project a07cd1888316403eb9c37610a310b76d. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:12:35.340315 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-ca32d32a-caab-4728-be3e-995e1840e822 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for user 1a1125811ba549e0ae66b26ad3949f23 and project a07cd1888316403eb9c37610a310b76d. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:12:35.382855 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ca32d32a-caab-4728-be3e-995e1840e822 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098761 Jul 26 03:12:35.391158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 131/250] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:12:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:36.219423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:36.220069 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:36.232535 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:36.233290 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:36.234555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:36.235806 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:36.762623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:36.783891 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:36.788933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:36.793311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-166cb261-0fce-406a-b285-80cae6b3a264 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.580863 Jul 26 03:12:36.795016 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 120/251] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:36 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:37.198309 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1640910113", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1a42af0-22f4-4dac-9f7e-d498fada0f45"}], "security_groups": [{"name": "tempest-securitygroup--865035445"}], "key_name": "tempest-keypair-1958253522", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:37.348746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] validate_networks() for [('f1a42af0-22f4-4dac-9f7e-d498fada0f45', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:12:37.372249 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3c9bb4ec-ee39-4bc5-afc7-a936b5241ef3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:37.372812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3c9bb4ec-ee39-4bc5-afc7-a936b5241ef3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:37.382615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3c9bb4ec-ee39-4bc5-afc7-a936b5241ef3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:37.383092 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3c9bb4ec-ee39-4bc5-afc7-a936b5241ef3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:37.383972 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3c9bb4ec-ee39-4bc5-afc7-a936b5241ef3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:37.384325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3c9bb4ec-ee39-4bc5-afc7-a936b5241ef3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:37.412229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3c9bb4ec-ee39-4bc5-afc7-a936b5241ef3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/ips" status: 200 len: 145 microversion: 2.1 time: 0.043909 Jul 26 03:12:37.420697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 121/252] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:12:37 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/ips => generated 145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:37.788557 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:12:37.788798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:12:37.789260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:12:37.789661 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:12:37.790177 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:12:37.800960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:37.801791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:37.802821 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:37.803274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:37.820160 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:37.820765 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:37.830705 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:37.832092 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:37.832921 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:37.833329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:37.841209 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for project a07cd1888316403eb9c37610a310b76d. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:12:37.853915 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Getting quotas for user 1a1125811ba549e0ae66b26ad3949f23 and project a07cd1888316403eb9c37610a310b76d. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:12:37.885733 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:12:37.892000 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:12:37.971484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-43227add-215b-4c00-94d9-7721bdaf0cdb tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.777628 Jul 26 03:12:37.972736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 132/253] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:12:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:12:37.987081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2d072b46-d166-40d3-a32c-6214ac26fde3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:37.987880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2d072b46-d166-40d3-a32c-6214ac26fde3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:38.123289 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2d072b46-d166-40d3-a32c-6214ac26fde3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:38.130432 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2d072b46-d166-40d3-a32c-6214ac26fde3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1246 microversion: 2.1 time: 0.150315 Jul 26 03:12:38.134840 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 133/254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:37 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1246 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:38.221264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:38.233457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:38.235008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:38.242623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f5ed3b2b-f95e-4c96-90db-b8b82e0d9f55 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.425158 Jul 26 03:12:38.248455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 122/255] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:37 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:12:38.960375 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bc2cc63b-e8bd-41f3-9698-bff80fbb4354 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:38.960898 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bc2cc63b-e8bd-41f3-9698-bff80fbb4354 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:38.981475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bc2cc63b-e8bd-41f3-9698-bff80fbb4354 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:38.981926 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bc2cc63b-e8bd-41f3-9698-bff80fbb4354 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:38.983879 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bc2cc63b-e8bd-41f3-9698-bff80fbb4354 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:38.984315 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bc2cc63b-e8bd-41f3-9698-bff80fbb4354 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:39.079512 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bc2cc63b-e8bd-41f3-9698-bff80fbb4354 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/ips" status: 200 len: 151 microversion: 2.1 time: 0.113934 Jul 26 03:12:39.081773 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 134/256] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:12:38 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/ips => generated 151 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:39.152850 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:39.156183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:39.178064 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:39.180502 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:39.182423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:39.185289 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:39.270929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:39.271704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:39.285882 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:39.290253 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:39.291681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:39.295341 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:39.332642 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:39.342916 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4972d518-5bf2-41c8-8881-f6c70e1ea67b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1298 microversion: 2.1 time: 0.194751 Jul 26 03:12:39.356172 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 123/257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:39 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1298 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:39.924025 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:39.940647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:39.942340 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:39.943562 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-02cc3794-e4f8-4769-8b56-15ffd982b502 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.677059 Jul 26 03:12:39.959348 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 135/258] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:39 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:12:40.369165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:40.370708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:40.384825 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:40.385642 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:40.386628 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:40.388457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:40.469872 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:40.484537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c5f9c80c-c542-46a5-9149-b4a988ecda49 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1304 microversion: 2.1 time: 0.121244 Jul 26 03:12:40.485406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 124/259] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:40 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:40.833491 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fcefdb86-7a3f-4cf7-b582-63384f16c673 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2475f64-e6e5-47b8-97fd-a4eb8ed57b82"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:40.835971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fcefdb86-7a3f-4cf7-b582-63384f16c673 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:40.842653 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcefdb86-7a3f-4cf7-b582-63384f16c673 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:40.843281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcefdb86-7a3f-4cf7-b582-63384f16c673 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:40.844137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcefdb86-7a3f-4cf7-b582-63384f16c673 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:40.844623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fcefdb86-7a3f-4cf7-b582-63384f16c673 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:40.969752 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:40.970488 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:40.978995 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:40.979442 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:40.980459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:40.981808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:41.242805 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:41.256500 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fcefdb86-7a3f-4cf7-b582-63384f16c673 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426759 Jul 26 03:12:41.256984 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:41.257892 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 136/260] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:12:40 2022] POST /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:41.259233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:41.260825 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d4196994-8444-4558-9b7d-4ff0412a9db8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.294965 Jul 26 03:12:41.276241 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-43c513e4-246c-4755-95c2-5190e36a044c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "252d01fa-9514-4776-b604-e357c63af876"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:41.279860 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 125/261] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:40 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:12:41.280511 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-43c513e4-246c-4755-95c2-5190e36a044c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:41.297354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c513e4-246c-4755-95c2-5190e36a044c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:41.297936 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c513e4-246c-4755-95c2-5190e36a044c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:41.298707 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c513e4-246c-4755-95c2-5190e36a044c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:41.309397 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c513e4-246c-4755-95c2-5190e36a044c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:41.507817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:41.508484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:41.531428 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:41.531869 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:41.540870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:41.541640 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:41.808571 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:41.819284 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1ece3fda-c269-4980-989e-cb36d8dfcdb7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.316946 Jul 26 03:12:41.821919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 126/262] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:41 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:42.306068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:42.307094 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:42.309967 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-43c513e4-246c-4755-95c2-5190e36a044c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.050334 Jul 26 03:12:42.315843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 137/263] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:12:41 2022] POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:42.344573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:42.345313 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:42.347047 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:42.347785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:42.403476 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:42.636907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:42.662506 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:42.671742 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:42.674057 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-110beae4-c841-489d-adb8-49c7add29689 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.391755 Jul 26 03:12:42.674758 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 127/264] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:42 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:42.845586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:42.846440 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:42.854967 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:42.857139 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:42.861455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:42.862718 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:42.864638 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:42.894698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3b8c3f20-86b6-4ecd-9f8c-718a17ad38e4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Action: 'create', calling method: .version_select at 0x7f5f797bef70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1243734906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+Kzj5arh3YnDHQd98YrFTwimnGw3i0TM4I9Qsx5NHWnGpQT0nzN6Zy8jHnzAh2E8/KRs8+l34q8fX8iwhs2mdPWx3yXw0um7kZfwyLv3piSkWwbv8vB4GArIDjqwLJYQ=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:42.920378 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-3b8c3f20-86b6-4ecd-9f8c-718a17ad38e4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Getting quotas for project bd8a79690708464a9c3ffe381667a03c. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:12:42.925108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-3b8c3f20-86b6-4ecd-9f8c-718a17ad38e4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Getting quotas for user 8697f1ada4214e15876b2c2ec6184ed7 and project bd8a79690708464a9c3ffe381667a03c. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:12:42.972214 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3b8c3f20-86b6-4ecd-9f8c-718a17ad38e4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.345224 Jul 26 03:12:42.973210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 138/265] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:12:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:12:43.106361 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:43.120016 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-41c789f6-0a54-422b-9c6d-c7c5205a9a9f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.277463 Jul 26 03:12:43.121479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 128/266] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:42 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:43.319475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-060120d9-9db3-4731-b9b1-de454ddbd1fa req-8ef2b07f-5c33-4a14-b707-6aed3e6a4990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7920448-33e8-41f5-bba8-1bb9e4ba6399", "tag": "00d6395a-b67a-4403-9103-923b188e56a9"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:43.339153 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-060120d9-9db3-4731-b9b1-de454ddbd1fa req-8ef2b07f-5c33-4a14-b707-6aed3e6a4990 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:43.340035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-060120d9-9db3-4731-b9b1-de454ddbd1fa req-8ef2b07f-5c33-4a14-b707-6aed3e6a4990 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:43.368361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-060120d9-9db3-4731-b9b1-de454ddbd1fa req-8ef2b07f-5c33-4a14-b707-6aed3e6a4990 service nova] Creating event network-changed:00d6395a-b67a-4403-9103-923b188e56a9 for instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 on hv-cinder-85084 Jul 26 03:12:43.375367 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-060120d9-9db3-4731-b9b1-de454ddbd1fa req-8ef2b07f-5c33-4a14-b707-6aed3e6a4990 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059183 Jul 26 03:12:43.376527 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 139/267] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:43.699815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:43.700556 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:43.725778 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:43.730222 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:43.731215 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:43.731876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:43.956149 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:43.965041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:43.967072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:43.968577 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-95139e57-5197-48e4-9af2-7cee1a452bde tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.274566 Jul 26 03:12:43.969288 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 129/268] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:43 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:44.142504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:44.143210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:44.150220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:44.150669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:44.151456 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:44.151883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:44.489796 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:44.497854 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f246395f-8ee2-4c60-99cd-7cfec3f2b6e4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.359574 Jul 26 03:12:44.510973 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 140/269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:44 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:44.991906 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:44.993405 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:45.000292 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:45.000744 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:45.001511 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:45.001947 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:45.140294 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:45.153612 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:45.157127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:45.158913 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9d7b07d2-7e45-475c-b9ab-b33ab667d5b2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.170950 Jul 26 03:12:45.159756 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 130/270] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:44 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:45.520722 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:45.521336 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:45.528785 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:45.529228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:45.529960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:45.530381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:45.660299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:45.672122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cbd0b4b5-cb49-41fb-9f49-d55fc8820b35 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.155414 Jul 26 03:12:45.672960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 141/271] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:45 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:46.184484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:46.185011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:46.191948 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:46.192394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:46.193155 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:46.193585 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:46.323102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:46.331824 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:46.333331 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:46.334487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c78b7405-2a16-4516-ada5-7b4ed20d55fd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.154211 Jul 26 03:12:46.335072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 131/272] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:46 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:46.696485 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:46.697085 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:46.704074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:46.704522 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:46.705278 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:46.705706 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:46.892809 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:46.905038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-316315db-6de0-4b3b-996d-733469c55e96 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.209415 Jul 26 03:12:46.905881 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 142/273] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:46 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:47.359181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:47.359893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:47.371671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:47.372229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:47.375533 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:47.377087 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:47.569529 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:47.578616 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:47.580280 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:47.581560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3284a8a3-3440-4651-af70-6ea7e4920eb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.226883 Jul 26 03:12:47.598084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 132/274] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:47 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:47.926567 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:47.927310 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:47.929918 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:47.937084 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:47.937533 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:47.938314 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:47.938742 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:47.955917 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:48.076008 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:48.084587 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-17886f6b-c5b8-467c-8c59-e61163fbf801 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.162147 Jul 26 03:12:48.085481 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 143/275] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:47 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:48.605331 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:48.605968 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:48.614315 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:48.614731 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:48.615731 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:48.616193 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:48.772662 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:48.780826 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:48.782343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:48.783600 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f530dad8-ff5c-4308-93e7-9d7e78bf9c22 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1743 microversion: 2.20 time: 0.182289 Jul 26 03:12:48.784111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 133/276] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:48 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:49.113024 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:49.113639 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:49.124640 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:49.125220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:49.126403 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:49.131596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:49.154695 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e007edf3-f222-4674-bd9b-61345803312b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: .version_select at 0x7f5f798aee50>, body: {"keypair": {"name": "tempest-keypair-115067543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8P/0omb9TXdwxq1c4fHr8MstNn2wT15wDWgJ1ETdIQ5bTbAlmrLHxIrjzTFk2yyBf0NB8MWYqU7ZJI6vrb+LdX5xi7tgX8aHJJiY8of0Qb49nH6YXFKYTx2ZNOD6cYSw=="}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:49.215215 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-e007edf3-f222-4674-bd9b-61345803312b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:12:49.222976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-e007edf3-f222-4674-bd9b-61345803312b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:12:49.281461 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e007edf3-f222-4674-bd9b-61345803312b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132159 Jul 26 03:12:49.282553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 134/277] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:12:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:12:49.391474 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:49.399710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-43c16975-c0bd-4dee-ae0b-ec5738ce328f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.297452 Jul 26 03:12:49.413371 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 144/278] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:49 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:49.809844 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:49.810455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:49.818279 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:49.818279 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:49.818672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:49.819128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:50.041370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:50.050026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:50.051544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:50.052693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c9bb0e72-13fc-480b-8fc8-098d60d26760 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1743 microversion: 2.20 time: 0.248708 Jul 26 03:12:50.053249 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 135/279] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:49 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:50.420823 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:50.421522 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:50.428029 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:50.428475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:50.429261 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:50.429683 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:50.568058 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:50.575764 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f6b3f6cc-c6b4-4cd1-b6a0-b555f90e3360 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.158961 Jul 26 03:12:50.577532 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 145/280] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:50 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:50.773252 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1633959773", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f744be8-1146-4ad7-825e-8d297f751ced"}], "security_groups": [{"name": "tempest-securitygroup--1376283620"}], "key_name": "tempest-keypair-115067543", "user_data": "}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:50.916172 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-46aad6d1-b2de-417d-9b3e-306252992b9c req-370f3157-915d-4bb6-8d04-f074c78713a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7920448-33e8-41f5-bba8-1bb9e4ba6399", "name": "network-vif-plugged", "status": "completed", "tag": "00d6395a-b67a-4403-9103-923b188e56a9"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:50.931759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-46aad6d1-b2de-417d-9b3e-306252992b9c req-370f3157-915d-4bb6-8d04-f074c78713a4 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:50.933213 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-46aad6d1-b2de-417d-9b3e-306252992b9c req-370f3157-915d-4bb6-8d04-f074c78713a4 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:50.949246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-46aad6d1-b2de-417d-9b3e-306252992b9c req-370f3157-915d-4bb6-8d04-f074c78713a4 service nova] Creating event network-vif-plugged:00d6395a-b67a-4403-9103-923b188e56a9 for instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 on hv-cinder-85084 Jul 26 03:12:50.955605 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-46aad6d1-b2de-417d-9b3e-306252992b9c req-370f3157-915d-4bb6-8d04-f074c78713a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043364 Jul 26 03:12:50.956826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 146/281] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:51.080465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:51.081283 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:51.092127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:51.092800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:51.093768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:51.094369 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:51.307113 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] validate_networks() for [('3f744be8-1146-4ad7-825e-8d297f751ced', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:12:51.457973 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:51.470086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:51.472541 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:51.474365 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c5796542-082a-419d-9b4b-3836c32395e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.401492 Jul 26 03:12:51.475025 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 147/282] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:51 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:51.597449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:51.598391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:51.605399 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:51.606013 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:51.606981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:51.607406 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:51.770467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:51.780911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1dfbcd67-0878-4e46-b23b-f912cce763a3 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.187629 Jul 26 03:12:51.781791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 148/283] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:51 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:51.877866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:12:51.878286 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:12:51.879058 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:12:51.879908 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:12:51.880464 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:12:51.902048 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:51.902788 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:51.903785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:51.904391 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:51.942094 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:12:51.952828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:12:51.966467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:12:51.975037 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:12:52.065810 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-74ac0c91-4cf9-4b3a-b609-606a39e2aa56 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.296828 Jul 26 03:12:52.079062 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 136/284] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:12:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:12:52.082836 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aeff90d0-6bd6-4046-a861-92a3c0f73b08 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:52.083562 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aeff90d0-6bd6-4046-a861-92a3c0f73b08 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:52.163456 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aeff90d0-6bd6-4046-a861-92a3c0f73b08 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:52.170163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aeff90d0-6bd6-4046-a861-92a3c0f73b08 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1241 microversion: 2.1 time: 0.091050 Jul 26 03:12:52.173561 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 149/285] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:52 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:52.498592 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:52.499688 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:52.508501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:52.508942 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:52.510760 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:52.511299 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:52.694233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:52.704878 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:52.706445 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:52.708058 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-152f71bd-46e4-42a9-a4b8-9e5b978830df tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.214553 Jul 26 03:12:52.709094 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 137/286] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:52 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:52.802695 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:52.803570 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:52.823494 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:52.827310 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:52.828411 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:52.828853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:52.977632 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-1025fa10-d536-4d65-95a2-629c7b3eca58 req-f6cbf8a9-2293-450d-a405-3ceeac6ed781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634ce020-f329-4f42-aca0-d419ac3ba613", "name": "network-vif-plugged", "status": "completed", "tag": "b87353fe-7737-4250-b95a-0e1027d7987e"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:52.988090 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-1025fa10-d536-4d65-95a2-629c7b3eca58 req-f6cbf8a9-2293-450d-a405-3ceeac6ed781 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:52.988524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-1025fa10-d536-4d65-95a2-629c7b3eca58 req-f6cbf8a9-2293-450d-a405-3ceeac6ed781 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:52.995224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:53.003954 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-1025fa10-d536-4d65-95a2-629c7b3eca58 req-f6cbf8a9-2293-450d-a405-3ceeac6ed781 service nova] Creating event network-vif-plugged:b87353fe-7737-4250-b95a-0e1027d7987e for instance 634ce020-f329-4f42-aca0-d419ac3ba613 on hv-cinder-85084 Jul 26 03:12:53.009946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6339de25-f96e-48ee-9da9-a61c016c24f5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1371 microversion: 2.1 time: 0.211679 Jul 26 03:12:53.011099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 150/287] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:52 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:53.025221 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-1025fa10-d536-4d65-95a2-629c7b3eca58 req-f6cbf8a9-2293-450d-a405-3ceeac6ed781 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050965 Jul 26 03:12:53.025836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 138/288] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:12:53.197933 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:53.198743 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:53.208806 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:53.210003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:53.211740 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:53.212641 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:53.293268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:53.305857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f97a2f5a-1bdf-4a2d-bd6a-2c216bf06b98 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1245 microversion: 2.1 time: 0.113000 Jul 26 03:12:53.306441 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 151/289] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:53 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:53.743500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:53.744956 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:53.752067 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:53.752505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:53.753296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:53.753725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:53.931333 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:53.939996 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:53.941538 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:53.942729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f38b6ed8-c4d9-4f75-a62a-16f7933ff614 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.209240 Jul 26 03:12:53.943631 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 139/290] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:53 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:54.030907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:54.031625 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:54.040651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:54.041093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:54.041911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:54.042394 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:54.208890 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:54.217472 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-082b275b-4da3-42d7-9980-e8eca84bda4b tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1565 microversion: 2.1 time: 0.190383 Jul 26 03:12:54.231153 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 152/291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:54 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:54.239435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-871456f3-5cfc-4adf-b376-f0fa651fd6ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:54.240266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-871456f3-5cfc-4adf-b376-f0fa651fd6ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:54.247185 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-871456f3-5cfc-4adf-b376-f0fa651fd6ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:54.247993 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-871456f3-5cfc-4adf-b376-f0fa651fd6ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:54.249040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-871456f3-5cfc-4adf-b376-f0fa651fd6ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:54.249701 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-871456f3-5cfc-4adf-b376-f0fa651fd6ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:54.325938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:54.327323 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:54.335225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:54.338736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:54.342431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:54.343274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:54.367578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-871456f3-5cfc-4adf-b376-f0fa651fd6ed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131464 Jul 26 03:12:54.380688 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 140/292] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:12:54 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:54.513245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:54.534772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aec41d9e-4516-4626-bd6d-0438b55e6eb5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1311 microversion: 2.1 time: 0.212590 Jul 26 03:12:54.536829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 153/293] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:54 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:54.981406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:54.982318 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:55.011689 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:55.012462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:55.013458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:55.014226 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:55.266360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:55.275933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:55.282510 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:55.287501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8ed3eab7-aefc-42ce-b997-b857bc78268b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.316379 Jul 26 03:12:55.303537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 141/294] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:54 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:55.558096 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:55.559442 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:55.569376 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:55.570086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:55.571102 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:55.571775 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:55.697000 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-02638271-8ec3-45c6-a0c8-18d59a6b7697 req-5d046cad-9e32-4fc5-b02d-bd2f2084a736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7920448-33e8-41f5-bba8-1bb9e4ba6399", "tag": "00d6395a-b67a-4403-9103-923b188e56a9"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:55.720050 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-02638271-8ec3-45c6-a0c8-18d59a6b7697 req-5d046cad-9e32-4fc5-b02d-bd2f2084a736 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:55.720776 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-02638271-8ec3-45c6-a0c8-18d59a6b7697 req-5d046cad-9e32-4fc5-b02d-bd2f2084a736 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:55.731255 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:55.743238 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f91796da-c603-4888-8895-469025bf9e8e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1299 microversion: 2.1 time: 0.187643 Jul 26 03:12:55.745941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 154/295] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:55 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:55.778163 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-02638271-8ec3-45c6-a0c8-18d59a6b7697 req-5d046cad-9e32-4fc5-b02d-bd2f2084a736 service nova] Creating event network-changed:00d6395a-b67a-4403-9103-923b188e56a9 for instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 on hv-cinder-85084 Jul 26 03:12:55.789409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-02638271-8ec3-45c6-a0c8-18d59a6b7697 req-5d046cad-9e32-4fc5-b02d-bd2f2084a736 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098913 Jul 26 03:12:55.793066 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 142/296] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:12:56.311932 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:56.312531 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:56.324120 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:56.327879 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:56.328889 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:56.331235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:56.771111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:56.772852 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:56.785815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:56.786261 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:56.788449 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:56.788449 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:56.860504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:56.881101 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:56.888030 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:56.891530 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7ee22179-e427-4c5e-be6a-8af87f59a313 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.583486 Jul 26 03:12:56.906592 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 155/297] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:56 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:57.024458 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6cdbcfff-e7a6-4cd5-a569-437b1bd3f027 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:57.043515 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdbcfff-e7a6-4cd5-a569-437b1bd3f027 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:57.044331 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6cdbcfff-e7a6-4cd5-a569-437b1bd3f027 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:57.067888 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:57.077226 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3b2a84ea-649c-4488-bd79-30f9c8463d29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1367 microversion: 2.1 time: 0.315170 Jul 26 03:12:57.090654 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 143/298] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:56 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:57.166418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6cdbcfff-e7a6-4cd5-a569-437b1bd3f027 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Going to try to stop instance {{(pid=118060) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 03:12:57.266080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6cdbcfff-e7a6-4cd5-a569-437b1bd3f027 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action" status: 202 len: 0 microversion: 2.1 time: 0.250910 Jul 26 03:12:57.267467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 156/299] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:12:57 2022] POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:12:57.278020 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:57.278938 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:57.296207 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:57.297170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:57.298235 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:57.299097 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:57.470009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-8a38e8e3-e64c-431d-aa5d-588edcfbf326 req-e0cb8af2-fc87-4de0-8ccd-26d2d8b82dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09c4f22-568d-47e5-85e7-0df4402648a5", "tag": "a2e79be8-72eb-4197-ab48-b9e19b2869db"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:12:57.489419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-8a38e8e3-e64c-431d-aa5d-588edcfbf326 req-e0cb8af2-fc87-4de0-8ccd-26d2d8b82dbf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:57.490399 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-8a38e8e3-e64c-431d-aa5d-588edcfbf326 req-e0cb8af2-fc87-4de0-8ccd-26d2d8b82dbf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:57.507333 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-8a38e8e3-e64c-431d-aa5d-588edcfbf326 req-e0cb8af2-fc87-4de0-8ccd-26d2d8b82dbf service nova] Creating event network-changed:a2e79be8-72eb-4197-ab48-b9e19b2869db for instance d09c4f22-568d-47e5-85e7-0df4402648a5 on hv-cinder-85084 Jul 26 03:12:57.519521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-8a38e8e3-e64c-431d-aa5d-588edcfbf326 req-e0cb8af2-fc87-4de0-8ccd-26d2d8b82dbf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052691 Jul 26 03:12:57.520748 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 157/300] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:12:57.574814 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:57.589442 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0f18607f-97ea-4c8e-98c3-b921cec153db tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.317511 Jul 26 03:12:57.590315 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 144/301] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:57 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:57.920510 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:57.921385 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:57.932499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:57.934568 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:57.935796 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:57.936345 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:58.109712 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:58.110894 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:58.117835 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:58.118570 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:58.119616 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:58.120188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:58.176316 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:58.185331 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:58.187206 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:58.188678 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bdb8955b-91d8-495a-841e-9b103985476b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.272390 Jul 26 03:12:58.204048 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 158/302] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:57 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:58.265045 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:58.275370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d15ae8f3-d2f5-417d-9c1f-a94b98849afa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1367 microversion: 2.1 time: 0.169441 Jul 26 03:12:58.275979 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 145/303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:58 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:12:58.611569 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:58.612568 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:58.619379 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:58.620025 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:58.620945 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:58.621375 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:58.786505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:58.796315 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1e95081d-e6d3-40a3-bd77-74a009e859af tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.188626 Jul 26 03:12:58.796939 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 159/304] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:58 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:59.213274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:59.214069 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:59.221119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:59.221563 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:59.222341 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:59.222768 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:59.298101 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:59.299480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:59.302224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:59.307796 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:59.308293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:59.309076 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:59.309505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:59.382582 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:59.394203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:59.395998 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:59.398435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fd687ef8-35da-4fab-9342-3da3410fc479 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.188579 Jul 26 03:12:59.411346 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 146/305] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:12:59 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:12:59.478074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:59.485773 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-655da7c7-6769-4aff-b5a9-baef3ec49e3e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1367 microversion: 2.1 time: 0.192659 Jul 26 03:12:59.486354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 160/306] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:59 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:12:59.817944 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:12:59.818924 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:12:59.827603 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:59.829022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:59.830018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:12:59.830555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:12:59.851389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:12:59.972386 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:12:59.983436 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b934e7da-ac9a-4144-afcd-743ff7197191 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.169448 Jul 26 03:12:59.984011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 147/307] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:12:59 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:00.437881 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:00.438498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:00.445954 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:00.446417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:00.447301 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:00.447730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:00.465564 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:00.505930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:00.510391 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:00.518552 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:00.519321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:00.520274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:00.520907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:00.604237 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:00.612924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:00.614796 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:00.619641 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3914fe84-9370-4082-9f64-c7880e19c5ae tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.185766 Jul 26 03:13:00.620412 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 161/308] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:00 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:00.677625 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:00.691408 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e5264631-0d02-477c-bb7a-6b1949fcda40 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1367 microversion: 2.1 time: 0.189326 Jul 26 03:13:00.691909 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 148/309] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:00 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:01.004215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:01.005191 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:01.011778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:01.012458 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:01.013228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:01.013659 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:01.160460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:01.169239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-679a3d32-866f-407a-b902-8d68bd040df1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.168848 Jul 26 03:13:01.169833 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 162/310] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:00 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:01.646063 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:01.646638 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:01.653578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:01.654270 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:01.655059 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:01.655495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:01.717009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:01.718364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:01.725759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:01.726304 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:01.727189 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:01.727634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:01.791417 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:01.800666 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:01.801898 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:01.803110 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-de193766-2c4a-4089-b930-824c0241743d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.160981 Jul 26 03:13:01.803670 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 149/311] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:01 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:01.868963 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:01.877171 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-87001939-cc14-4fa7-a077-cb7cddcbc7b9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1367 microversion: 2.1 time: 0.164052 Jul 26 03:13:01.877714 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 163/312] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:01 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:02.194157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:02.195187 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:02.197843 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:02.198988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=10 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:02.208777 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:02.209412 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:02.210497 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:02.211336 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:02.371757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:02.380344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-86015694-a955-422d-8c3b-18bb91cc7cf1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.191787 Jul 26 03:13:02.380778 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 150/313] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:02 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:02.827889 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:02.829200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:02.837909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=18 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:02.841208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-9b2d879d-e924-4e5a-91df-f28d479616c4 req-e5357337-b085-403e-8c21-7e966409a503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09c4f22-568d-47e5-85e7-0df4402648a5", "name": "network-vif-plugged", "status": "completed", "tag": "a2e79be8-72eb-4197-ab48-b9e19b2869db"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:02.843471 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:02.844161 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:02.845468 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:02.846100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:02.873289 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-9b2d879d-e924-4e5a-91df-f28d479616c4 req-e5357337-b085-403e-8c21-7e966409a503 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:02.873735 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-9b2d879d-e924-4e5a-91df-f28d479616c4 req-e5357337-b085-403e-8c21-7e966409a503 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:02.903970 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-9b2d879d-e924-4e5a-91df-f28d479616c4 req-e5357337-b085-403e-8c21-7e966409a503 service nova] Creating event network-vif-plugged:a2e79be8-72eb-4197-ab48-b9e19b2869db for instance d09c4f22-568d-47e5-85e7-0df4402648a5 on hv-cinder-85084 Jul 26 03:13:02.921315 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-9b2d879d-e924-4e5a-91df-f28d479616c4 req-e5357337-b085-403e-8c21-7e966409a503 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084822 Jul 26 03:13:02.922472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 151/314] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:02.935850 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:02.937134 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:02.945515 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:02.945983 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:02.946934 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:02.947403 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:03.106462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:03.125171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:03.129352 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:03.131958 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:03.133187 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-48cc4c91-7d2c-4c23-a7e6-aaa2b6b0aac9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.311038 Jul 26 03:13:03.133491 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7a6cc7cd-207e-4818-ad49-c9451c964ab0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1367 microversion: 2.1 time: 0.209515 Jul 26 03:13:03.134332 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 152/315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:02 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:03.147299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 164/316] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:02 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:03.401734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:03.402486 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:03.409306 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:03.409853 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:03.410705 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:03.411276 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:03.433570 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1293031254", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1243734906", "security_groups": [{"name": "tempest-secgroup-smoke-1416688317"}], "networks": [{"uuid": "48ca9a71-9e56-49fc-b31b-af70124adfe1"}], "block_device_mapping_v2": [{"uuid": "e790af6f-9e0c-4c5d-baea-a1796d2e56a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:03.558760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] validate_networks() for [('48ca9a71-9e56-49fc-b31b-af70124adfe1', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:13:03.561537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:03.576869 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-31f34cdb-76cb-44aa-a780-5d85ac70f414 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.178620 Jul 26 03:13:03.577451 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 153/317] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:03 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:03.941987 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:13:03.942483 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:13:03.942869 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:13:03.943457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:13:03.943866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:13:03.954276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:03.954734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:03.955553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:03.955987 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:03.973605 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Getting quotas for project bd8a79690708464a9c3ffe381667a03c. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:13:03.978227 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Getting quotas for user 8697f1ada4214e15876b2c2ec6184ed7 and project bd8a79690708464a9c3ffe381667a03c. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:13:04.038778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:13:04.041035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e790af6f-9e0c-4c5d-baea-a1796d2e56a3',volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:13:04.155280 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:04.155916 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:04.162617 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:04.163094 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:04.163861 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:04.164296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:04.175547 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8d78fa02-ce81-4849-8527-2bcae68fd4dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747017 Jul 26 03:13:04.182131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 165/318] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:13:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 03:13:04.182131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:04.182131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:04.187688 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:04.188131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:04.188884 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:04.189306 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:04.315308 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:04.324074 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-be1c7bb6-44d9-4f5c-8ee2-0bdedac67b1e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1367 microversion: 2.1 time: 0.173135 Jul 26 03:13:04.324725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 154/319] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:04 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:04.329776 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9473ba06-a94b-450f-ac81-ce027b9560a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:04.330552 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9473ba06-a94b-450f-ac81-ce027b9560a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:04.338736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:04.347036 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:04.348602 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:04.349877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fc337a28-8766-4ff2-ba82-4b27bfe9613a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1738 microversion: 2.20 time: 0.172827 Jul 26 03:13:04.350687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 166/320] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:04 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:04.386892 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9473ba06-a94b-450f-ac81-ce027b9560a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:04.394592 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9473ba06-a94b-450f-ac81-ce027b9560a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1089 microversion: 2.1 time: 0.068716 Jul 26 03:13:04.395385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 155/321] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:04 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:04.599089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:04.599687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:04.605942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:04.606383 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:04.607431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:04.607730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:04.752447 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:04.760654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b0e5b204-9aad-4505-9f96-1a49894283cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.165487 Jul 26 03:13:04.761220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 167/322] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:04 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:05.349074 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:05.349677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:05.356183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.356629 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.357561 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.358024 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.373478 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:05.374085 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:05.380945 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.381397 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.382164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.382599 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.488550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:05.496489 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-592f3027-5d36-44b9-8397-c3c063933801 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1558 microversion: 2.1 time: 0.152527 Jul 26 03:13:05.497309 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 156/323] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:05 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:05.501763 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:05.502338 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:05.508227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.509068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.509822 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.510258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.519244 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:05.527340 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:05.528824 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:05.529984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2108108a-23df-4a5d-85dc-80a642d2c16c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1720 microversion: 2.20 time: 0.160623 Jul 26 03:13:05.530539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 168/324] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:05 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:13:05.535438 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-32da8a42-3d81-43b6-be96-ad4772e5c14c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:05.535921 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-32da8a42-3d81-43b6-be96-ad4772e5c14c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:05.542100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32da8a42-3d81-43b6-be96-ad4772e5c14c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.542757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32da8a42-3d81-43b6-be96-ad4772e5c14c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.543600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32da8a42-3d81-43b6-be96-ad4772e5c14c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.544029 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-32da8a42-3d81-43b6-be96-ad4772e5c14c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.577526 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:05.585302 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-51c2a765-6c0c-427e-a909-4ecab1155faa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1187 microversion: 2.1 time: 0.087242 Jul 26 03:13:05.586158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 157/325] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:05 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:05.657050 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-32da8a42-3d81-43b6-be96-ad4772e5c14c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125042 Jul 26 03:13:05.658081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 169/326] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:13:05 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:05.783163 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:05.784461 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:05.791910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.792377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:05.793504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:05.794141 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:06.420555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:06.429381 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-56774a76-e010-4867-bed0-4c17663e3232 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.651101 Jul 26 03:13:06.429929 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 158/327] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:05 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:06.554827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:06.556078 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:06.563290 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:06.563721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:06.564516 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:06.564943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:06.608339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:06.609266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:06.616151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:06.616594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:06.617877 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:06.618396 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:06.696018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:06.705920 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7cb1a638-141c-427e-b1f0-696b08fdfe6b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1205 microversion: 2.1 time: 0.102009 Jul 26 03:13:06.707245 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 159/328] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:06 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1205 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:06.709734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:06.718360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:06.719897 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:06.721480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ec40c164-ab9f-4576-9b3f-eed4fa6f3d81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1720 microversion: 2.20 time: 0.171265 Jul 26 03:13:06.723038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 170/329] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:06 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:06.779117 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-dcd8470d-a5fe-45ae-92ef-5023949ee276 req-aa72e685-0bc4-47b0-a459-135ae82ab2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634ce020-f329-4f42-aca0-d419ac3ba613", "name": "network-vif-unplugged", "status": "completed", "tag": "b87353fe-7737-4250-b95a-0e1027d7987e"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:06.789259 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-dcd8470d-a5fe-45ae-92ef-5023949ee276 req-aa72e685-0bc4-47b0-a459-135ae82ab2ab service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:06.789874 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-dcd8470d-a5fe-45ae-92ef-5023949ee276 req-aa72e685-0bc4-47b0-a459-135ae82ab2ab service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:06.801764 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-dcd8470d-a5fe-45ae-92ef-5023949ee276 req-aa72e685-0bc4-47b0-a459-135ae82ab2ab service nova] Creating event network-vif-unplugged:b87353fe-7737-4250-b95a-0e1027d7987e for instance 634ce020-f329-4f42-aca0-d419ac3ba613 on hv-cinder-85084 Jul 26 03:13:06.806757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-dcd8470d-a5fe-45ae-92ef-5023949ee276 req-aa72e685-0bc4-47b0-a459-135ae82ab2ab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031352 Jul 26 03:13:06.807390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 160/330] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:07.172014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-44d0d15e-8b13-4bc5-93ce-8b55fc6e0b81 req-db0f8933-a1e4-47e4-a01e-1df26f2cf8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09c4f22-568d-47e5-85e7-0df4402648a5", "tag": "a2e79be8-72eb-4197-ab48-b9e19b2869db"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:07.181853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-44d0d15e-8b13-4bc5-93ce-8b55fc6e0b81 req-db0f8933-a1e4-47e4-a01e-1df26f2cf8b9 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:07.182292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-44d0d15e-8b13-4bc5-93ce-8b55fc6e0b81 req-db0f8933-a1e4-47e4-a01e-1df26f2cf8b9 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:07.193794 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-44d0d15e-8b13-4bc5-93ce-8b55fc6e0b81 req-db0f8933-a1e4-47e4-a01e-1df26f2cf8b9 service nova] Creating event network-changed:a2e79be8-72eb-4197-ab48-b9e19b2869db for instance d09c4f22-568d-47e5-85e7-0df4402648a5 on hv-cinder-85084 Jul 26 03:13:07.199335 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-44d0d15e-8b13-4bc5-93ce-8b55fc6e0b81 req-db0f8933-a1e4-47e4-a01e-1df26f2cf8b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030969 Jul 26 03:13:07.200162 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 171/331] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:07.452622 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:07.453169 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:07.460029 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:07.460481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:07.461233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:07.461679 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:07.595884 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:07.604611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-769d6449-994a-4474-a552-e078efdef340 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.157095 Jul 26 03:13:07.605174 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 161/332] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:07 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:07.729232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:07.729771 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:07.736710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:07.737160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:07.737916 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:07.738371 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:07.745087 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:07.746007 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:07.752796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:07.765655 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:07.767126 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:07.768022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:07.823684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:07.832753 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f20afc09-f9ae-451d-9b06-2754a6c9195c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1205 microversion: 2.1 time: 0.108133 Jul 26 03:13:07.833427 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 172/333] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:07 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1205 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:08.060813 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:08.085681 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:08.089573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:08.091974 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-cd4f0ae8-3618-41cd-bc8f-8e973793fafb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1720 microversion: 2.20 time: 0.350712 Jul 26 03:13:08.093165 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 162/334] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:07 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1720 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:08.625696 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:08.626377 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:08.632814 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:08.633261 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:08.634151 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:08.634578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:08.821894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:08.830404 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9231ff9d-fee1-421c-b9c1-8a6c013972ff tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.208599 Jul 26 03:13:08.831242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 173/335] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:08 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:08.853443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:08.854043 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:08.860565 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:08.861010 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:08.861789 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:08.863123 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.072476 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:09.085998 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6ebf63eb-6cdf-4a66-a033-1d6c84806efb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.236269 Jul 26 03:13:09.087026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 163/336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:08 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:09.114581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:09.115575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:09.122096 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.122782 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.123749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.124187 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.272287 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:09.282503 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:09.284371 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-f332b90d-29cd-4223-bd9c-906ff0102673 req-9c005633-28c5-448e-ae1a-554afb940bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c126b57-79ad-4bd0-9f2a-db16536258e3", "tag": "62b3e7a3-0978-4f57-a2ab-7e3928be96f1"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:09.284733 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:09.286245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e2e7726e-7b75-4e7e-b4e1-3e3168622c29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1663 microversion: 2.20 time: 0.175520 Jul 26 03:13:09.287960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 174/337] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:09 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:09.292357 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:09.298908 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-f332b90d-29cd-4223-bd9c-906ff0102673 req-9c005633-28c5-448e-ae1a-554afb940bab service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.299776 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-f332b90d-29cd-4223-bd9c-906ff0102673 req-9c005633-28c5-448e-ae1a-554afb940bab service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.316759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-f332b90d-29cd-4223-bd9c-906ff0102673 req-9c005633-28c5-448e-ae1a-554afb940bab service nova] Creating event network-changed:62b3e7a3-0978-4f57-a2ab-7e3928be96f1 for instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 on hv-cinder-85084 Jul 26 03:13:09.325064 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-f332b90d-29cd-4223-bd9c-906ff0102673 req-9c005633-28c5-448e-ae1a-554afb940bab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044112 Jul 26 03:13:09.325671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 164/338] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:09.329709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1a0aa6d0-bb0b-4a88-9517-7bc36c8ce11e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13b2f9bb-8417-46ed-8b06-f2b3e1aa4fe0"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:09.332379 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1a0aa6d0-bb0b-4a88-9517-7bc36c8ce11e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:09.340523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0aa6d0-bb0b-4a88-9517-7bc36c8ce11e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.340976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0aa6d0-bb0b-4a88-9517-7bc36c8ce11e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.341851 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0aa6d0-bb0b-4a88-9517-7bc36c8ce11e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.342289 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0aa6d0-bb0b-4a88-9517-7bc36c8ce11e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.649146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1a0aa6d0-bb0b-4a88-9517-7bc36c8ce11e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333872 Jul 26 03:13:09.649880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 175/339] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Jul 26 03:13:09 2022] POST /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments => generated 188 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:13:09.785274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c9348cb6-f5f0-4c17-a162-78406b87755f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:09.785918 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c9348cb6-f5f0-4c17-a162-78406b87755f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:09.793158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9348cb6-f5f0-4c17-a162-78406b87755f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.793699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9348cb6-f5f0-4c17-a162-78406b87755f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.794528 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9348cb6-f5f0-4c17-a162-78406b87755f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.795087 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c9348cb6-f5f0-4c17-a162-78406b87755f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.851967 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:09.852800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:09.860050 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.860493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.861258 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.861678 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.888905 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c9348cb6-f5f0-4c17-a162-78406b87755f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/action" status: 202 len: 0 microversion: 2.20 time: 0.107826 Jul 26 03:13:09.892595 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 165/340] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Jul 26 03:13:09 2022] POST /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:13:09.897453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:09.898139 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:09.904951 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.905463 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.906289 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:09.906774 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:09.911959 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:09.996776 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:10.005305 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-10cc878b-3425-4527-bf19-73b7c41987e4 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.157201 Jul 26 03:13:10.006412 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 176/341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:09 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:10.080166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:10.089840 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:10.091471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:10.092696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-142cf5a3-7993-469d-a33a-88923b81db0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1749 microversion: 2.20 time: 0.199111 Jul 26 03:13:10.093248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 166/342] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:09 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:10.107913 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:10.108798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:10.115147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:10.115682 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:10.116480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:10.116975 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:10.121224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:10.257978 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:10.266282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2543a967-b1c4-48aa-9eb9-ffe454c6c05d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.161913 Jul 26 03:13:10.266978 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 177/343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:10 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:11.029031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:11.029640 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:11.036879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:11.037327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:11.038129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:11.038566 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:11.116575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:11.117334 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:11.124518 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:11.125431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:11.125874 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:11.126376 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:11.178352 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:11.187421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6ade2af5-5e2a-4855-acd8-38e8d7a19986 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.162281 Jul 26 03:13:11.187991 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 167/344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:11 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:11.262589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:11.275280 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:11.276776 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:11.277996 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-25ae8593-3411-46c9-9ee3-7bc9cce7e67e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1751 microversion: 2.20 time: 0.165400 Jul 26 03:13:11.278551 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 178/345] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:11 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:13:11.287358 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:11.288039 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:11.294245 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:11.294687 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:11.295456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:11.295878 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:11.430509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:11.442110 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e6b28658-bd45-4387-88f2-cfa8cf32419d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.158427 Jul 26 03:13:11.442802 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 168/346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:11 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:12.209216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:12.209814 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:12.216769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:12.217203 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:12.217969 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:12.218396 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:12.301430 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:12.302163 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:12.310130 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:12.310696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:12.311627 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:12.312153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:12.350849 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:12.359453 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5ec72162-cfcf-4d5e-96cb-3821f2f45f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1723 microversion: 2.1 time: 0.154064 Jul 26 03:13:12.360267 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 179/347] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:12 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:12.464783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:12.465479 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:12.471844 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:12.472299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:12.473069 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:12.473502 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:12.545670 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:12.558553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:12.560243 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:12.561644 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-46e74434-3d79-42a7-b1b9-115edab8f8f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.264557 Jul 26 03:13:12.562558 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 169/348] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:12 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:12.608326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:12.616134 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3fc8c5b0-6bd7-4cdb-9cf1-cf3d403e7381 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.155357 Jul 26 03:13:12.616710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 180/349] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:12 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:13.380983 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:13.381578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:13.388672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.389128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.389904 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.390316 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.585015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:13.585611 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:13.586817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:13.593157 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.593816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.594787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.595440 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.596330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6c2ecee5-9a7d-42cb-9935-992732b4ddf5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1700 microversion: 2.1 time: 0.219079 Jul 26 03:13:13.604962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 170/350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:13 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1700 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:13.621010 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b0acd204-02be-4625-8a9b-3bec033251ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:13.628562 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b0acd204-02be-4625-8a9b-3bec033251ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.629258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b0acd204-02be-4625-8a9b-3bec033251ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.712662 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b0acd204-02be-4625-8a9b-3bec033251ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Going to try to start instance {{(pid=118059) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 03:13:13.763573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b0acd204-02be-4625-8a9b-3bec033251ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action" status: 202 len: 0 microversion: 2.1 time: 0.146487 Jul 26 03:13:13.767830 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 171/351] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:13:13 2022] POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:13:13.773750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:13.774465 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:13.781296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.781749 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.782806 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.783201 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.796682 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:13.809250 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:13.811483 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:13.813007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-51fc28fb-ce66-4e99-89b5-c85524eef488 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.231765 Jul 26 03:13:13.823166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 181/352] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:13 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:13.823166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:13.823166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:13.825700 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.826485 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.827267 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:13.827691 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:13.962054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:13.966144 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:13.975389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e992985a-bd79-47bd-9642-3d16457df7f0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.206212 Jul 26 03:13:13.975968 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 172/353] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:13 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:13.986292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:13.988867 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:14.000635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e09d6876-abb9-41ed-b40b-f06c064343c3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.182649 Jul 26 03:13:14.001684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 182/354] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:13 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:14.837688 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:14.838227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:14.840665 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:14.846976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:14.847889 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:14.848693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:14.849071 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:14.983404 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:14.992078 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:14.993655 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:14.994809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-04da66d5-934d-489f-a227-b3c49c5ed4f9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.161364 Jul 26 03:13:14.995698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 173/355] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:14 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:14.996030 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:14.996710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:15.006168 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:15.006738 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:15.007673 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:15.008191 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:15.023685 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:15.024569 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:15.031547 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:15.032018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:15.032899 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:15.033328 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:15.160291 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:15.170781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7ea0f577-48f6-44c9-b8dc-03a85f873e22 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.178417 Jul 26 03:13:15.172120 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 183/356] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:14 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:15.189561 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:15.198315 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e14b315e-a5ca-42e2-a385-ea2013146dfe tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.178785 Jul 26 03:13:15.202993 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 174/357] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:15 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:16.021060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:16.021641 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:16.028740 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:16.029182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:16.029941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:16.030416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:16.168366 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:16.178276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:16.179849 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:16.181010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-531c8be1-d16c-4ec7-b667-be804c84fc17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.165096 Jul 26 03:13:16.181845 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 184/358] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:16 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:16.201807 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:16.202409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:16.209566 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:16.210013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:16.210767 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:16.211227 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:16.220623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:16.221308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:16.228001 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:16.228455 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:16.229258 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:16.229685 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:16.392345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:16.407751 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8df221b0-a2ea-45f4-873a-b568ea4b843f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.209694 Jul 26 03:13:16.408169 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 175/359] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:16 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:16.433981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:16.445121 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-792b896e-566b-4426-a268-16c4b3a02a0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.228492 Jul 26 03:13:16.445902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 185/360] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:16 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:17.204202 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:17.204806 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:17.211698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:17.212148 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:17.212927 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:17.213420 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:17.349621 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:17.358496 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:17.360022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:17.361186 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9704f657-ab0a-4e42-8430-2b3b2bf8298c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.161351 Jul 26 03:13:17.361961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 176/361] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:17 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:17.442222 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:17.443717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:17.452040 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:17.457831 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:17.459082 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:17.459611 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:17.470875 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:17.471516 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:17.478709 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:17.479417 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:17.480064 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:17.480488 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:17.611087 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:17.619772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-caf6f149-208c-4f01-b3e9-27587ce34cbb tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.181950 Jul 26 03:13:17.631232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 186/362] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:17 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:17.633361 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:17.640621 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-30d91526-84c7-4390-abb2-47f6f861a08e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.176317 Jul 26 03:13:17.641399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 177/363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:17 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:18.385133 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:18.385759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:18.392088 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:18.392532 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:18.393312 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:18.393733 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:18.532810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:18.542577 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:18.544765 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:18.545576 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-64bbd405-37dd-4435-be86-53cb840e8e75 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.165000 Jul 26 03:13:18.550237 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 187/364] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:18 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:18.641393 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:18.641985 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:18.648767 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:18.649215 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:18.650073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:18.650585 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:18.662667 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:18.663682 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:18.671006 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:18.671564 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:18.672423 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:18.672915 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:18.814142 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:18.822059 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-56ac2bfa-6966-4b6c-b4f8-398d23561d34 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.184608 Jul 26 03:13:18.823456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 178/365] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:18 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:18.826370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:18.835245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f48762aa-9ccf-4138-89e1-de13ded90f0c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.176807 Jul 26 03:13:18.836066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 188/366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:18 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:19.569728 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:19.570208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:19.576921 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:19.577367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:19.578129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:19.578554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:19.715360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:19.726218 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:19.729768 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:19.731148 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a1582e66-28d5-457f-91a4-0e0d40fa7e79 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.165422 Jul 26 03:13:19.732396 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 179/367] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:19 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:19.843719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:19.844304 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:19.851284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:19.852079 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:19.853177 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:19.854047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:19.856933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:19.857553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:19.864467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:19.864924 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:19.865686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:19.866336 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:20.024002 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:20.027679 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:20.032714 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a51e531e-2aad-40aa-b84a-664234c8d4ef tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.192874 Jul 26 03:13:20.034990 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 189/368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:19 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:20.044064 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-68d3d538-6f7d-4cab-b0b0-c52bd8c5dd38 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.191375 Jul 26 03:13:20.044818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 180/369] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:19 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:20.754051 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:20.754770 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:20.761435 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:20.762011 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:20.762933 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:20.763482 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:20.899505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:20.909248 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:20.910760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:20.911971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-feebb4bc-f11a-4ce6-a874-46faf1d124d6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.162067 Jul 26 03:13:20.913066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 190/370] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:20 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:21.054190 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:21.055039 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:21.062601 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:21.063086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:21.063863 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:21.064298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:21.065644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:21.066974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:21.073827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:21.074569 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:21.075709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:21.076704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:21.215505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:21.221685 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:21.224068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0bec7e75-c0ba-4dd7-9e64-12a3599151d4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.173998 Jul 26 03:13:21.224660 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 181/371] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:21 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:21.247488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:21.255805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-601b286f-3146-4224-adc5-cc00a3273c50 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.193886 Jul 26 03:13:21.256357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 191/372] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:21 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:21.935517 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:21.936023 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:21.943421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:21.943904 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:21.945011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:21.945494 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:22.086199 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:22.096675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:22.098323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:22.099619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0bfecf0c-141a-4be8-86b8-23e728a2a243 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.168254 Jul 26 03:13:22.100467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 182/373] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:21 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:22.246808 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:22.247449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:22.253934 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:22.254382 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:22.255348 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:22.255615 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:22.276420 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:22.277019 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:22.283765 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:22.284208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:22.284986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:22.285407 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:22.413012 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:22.421953 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-051c5615-3a6f-4e68-b3ae-2d4583ce28dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.180439 Jul 26 03:13:22.422901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 192/374] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:22 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:22.429506 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:22.438304 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3a32ac24-5dba-48e3-bf91-7c085a38d86a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.165751 Jul 26 03:13:22.438997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 183/375] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:22 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:23.122999 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:23.123865 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:23.130578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:23.131056 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:23.131821 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:23.132254 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:23.272065 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:23.274476 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:23.282367 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:23.283729 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:23.284915 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-75805e1f-30f5-45ec-9dbb-613432d3bf06 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.166193 Jul 26 03:13:23.285465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 193/376] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:23 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:23.444145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:23.444783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:23.451806 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:23.452253 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:23.453187 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:23.453695 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:23.461654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:23.462250 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:23.468317 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:23.468769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:23.469516 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:23.470123 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:23.587441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:23.594983 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-61daa1ae-8444-443f-8c4c-9080d177429b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.154999 Jul 26 03:13:23.595564 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 184/377] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:23 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:23.601578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:23.609775 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e228997d-27bc-4eba-a9c2-09a71d14f580 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.152299 Jul 26 03:13:23.610338 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 194/378] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:23 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:24.312732 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:24.313896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:24.324555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:24.325295 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:24.326923 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:24.327750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:24.457998 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:24.466432 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:24.467963 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:24.469124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1e029a2b-8463-4240-ba81-ca7c43a09f0d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.163664 Jul 26 03:13:24.469635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 185/379] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:24 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:24.617216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:24.617819 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:24.625135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:24.625579 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:24.626333 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:24.626768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:24.630441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:24.631075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:24.637504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:24.637947 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:24.638711 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:24.639167 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:24.759190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:24.770147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7c3bcb51-88e7-4d58-9a2f-cc25832e00fa tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.156448 Jul 26 03:13:24.771012 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 195/380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:24 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:24.776445 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:24.784948 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-2ecc66cc-3a11-4ad8-9afa-71d949f1687c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.158322 Jul 26 03:13:24.785751 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 186/381] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:24 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:25.493268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:25.493872 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:25.500398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:25.500842 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:25.501604 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:25.502029 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:25.639432 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:25.649000 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:25.650602 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:25.651890 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-84f1cd4f-d424-442e-b4b3-048e83934da3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.162961 Jul 26 03:13:25.652562 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 196/382] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:25 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:25.791373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:25.791935 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:25.800553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:25.801145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:25.802028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:25.802559 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:25.807061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:25.807654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:25.814324 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:25.814759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:25.815758 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:25.816190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:25.950491 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:25.959672 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-766134c2-598f-4ff0-b1c6-afb3643ae2ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.156555 Jul 26 03:13:25.960332 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 197/383] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:25 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:26.025161 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:26.033018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e542135e-ae39-4336-80f0-913cf9fbd82e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.245698 Jul 26 03:13:26.033579 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 187/384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:25 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:26.678889 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:26.679891 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:26.690779 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:26.691597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:26.692833 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:26.693577 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:26.831564 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:26.840273 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:26.841860 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:26.843132 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ed6bc03e-998d-40df-a316-f1f9690ca65e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.170828 Jul 26 03:13:26.843769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 198/385] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:26 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:26.986465 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:26.987584 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:26.995903 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:26.996341 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:26.997098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:26.997523 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:27.053293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:27.053949 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:27.060081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:27.060524 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:27.061270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:27.061844 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:27.135661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:27.143714 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-772e2b2d-3a89-4046-b81c-d92ad70462f5 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1709 microversion: 2.1 time: 0.165538 Jul 26 03:13:27.144286 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 188/386] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:26 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:27.192472 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:27.200018 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-775e32f1-c2ee-4654-94b7-eddeb682bbbe tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.150659 Jul 26 03:13:27.200579 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 199/387] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:27 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:27.870647 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:27.871867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:27.879842 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:27.880315 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:27.881303 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:27.881830 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:28.024641 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:28.033289 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:28.034758 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:28.035919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ec9f9f38-5680-4642-8aa7-45c0d42c4da5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.171865 Jul 26 03:13:28.036475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 189/388] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:27 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:28.169246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:28.170125 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:28.178598 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:28.179177 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:28.180074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:28.180588 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:28.221441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:28.222125 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:28.228682 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:28.229228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:28.230124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:28.230914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:28.314921 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:28.323238 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b6c559bb-e0c0-4663-9bc6-1e8ea8c30c1e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1713 microversion: 2.1 time: 0.160511 Jul 26 03:13:28.323812 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 200/389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:28 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:28.364047 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:28.371494 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9a16285e-0eac-456f-b571-301a84fd67c4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.153967 Jul 26 03:13:28.372084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 190/390] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:28 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:28.926436 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-dcc80722-fac3-4d5e-afe5-41a76b008882 req-6502e586-d321-468e-bb20-95232602e521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c126b57-79ad-4bd0-9f2a-db16536258e3", "name": "network-vif-plugged", "status": "completed", "tag": "62b3e7a3-0978-4f57-a2ab-7e3928be96f1"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:28.936866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-dcc80722-fac3-4d5e-afe5-41a76b008882 req-6502e586-d321-468e-bb20-95232602e521 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:28.937356 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-dcc80722-fac3-4d5e-afe5-41a76b008882 req-6502e586-d321-468e-bb20-95232602e521 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:28.949966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-dcc80722-fac3-4d5e-afe5-41a76b008882 req-6502e586-d321-468e-bb20-95232602e521 service nova] Creating event network-vif-plugged:62b3e7a3-0978-4f57-a2ab-7e3928be96f1 for instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 on hv-cinder-85084 Jul 26 03:13:28.955736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-dcc80722-fac3-4d5e-afe5-41a76b008882 req-6502e586-d321-468e-bb20-95232602e521 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033004 Jul 26 03:13:28.956354 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 201/391] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:29.064424 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:29.065985 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:29.075303 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:29.076394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:29.078021 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:29.078459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:29.241422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:29.250375 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:29.251807 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:29.252956 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bc7f2ce0-dec6-4e80-a48e-47f074734e29 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.193968 Jul 26 03:13:29.253784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 191/392] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:29 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:29.397540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:29.398688 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:29.402504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:29.410108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:29.410556 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:29.411356 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:29.411773 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:29.546630 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:29.554521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d554f433-7094-4c63-ab00-c5f6491251f3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.164022 Jul 26 03:13:29.555121 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 202/393] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:29 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:30.280270 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:30.281060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:30.288806 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:30.289306 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:30.290138 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:30.290615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:30.439471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:30.452731 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:30.454276 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:30.455491 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-afa3e046-c046-483f-906d-a95dd3c53a5f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.182002 Jul 26 03:13:30.455992 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 192/394] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:30 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:30.579735 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:30.580802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:30.592047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:30.592777 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:30.594023 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:30.594731 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:30.734581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:30.742171 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6dd72da1-3650-408a-9da8-6e0dbe7cb403 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1261 microversion: 2.1 time: 0.169492 Jul 26 03:13:30.742741 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 203/395] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:30 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:31.482030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:31.483094 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:31.494134 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:31.494871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:31.496157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:31.496863 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:31.625908 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:31.634920 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:31.636423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:31.637562 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-52ef85b9-851d-462a-abb0-544f3e0bc71e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.162074 Jul 26 03:13:31.638103 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 193/396] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:31 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:31.766667 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:31.767554 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:31.778428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:31.779224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:31.780602 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:31.781011 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:31.923340 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:31.931003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-96f8d561-3b6e-4578-9f79-078b0bed7965 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1445 microversion: 2.1 time: 0.170861 Jul 26 03:13:31.931730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 204/397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:31 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:31.951829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:31.952557 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:31.959456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:31.959898 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:31.960635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:31.961060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:32.112423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:32.120711 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3273c0e7-1b1d-476d-89e0-c2476c98f3fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1445 microversion: 2.1 time: 0.173038 Jul 26 03:13:32.121281 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 194/398] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:31 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:32.660523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:32.661147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:32.667535 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:32.667983 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:32.668734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:32.669182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:32.815397 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:32.824577 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:32.826633 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:32.827940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9392e7fb-002f-4db0-9bf7-dec4ba92ba63 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.171453 Jul 26 03:13:32.828495 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 205/399] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:32 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:33.852762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:33.854082 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:33.862112 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:33.862790 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:33.863734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:33.864348 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:33.917831 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-ace95c9a-254a-45f0-b343-4308ae0248fc req-06344561-68f8-4572-b1ad-11202a257f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c126b57-79ad-4bd0-9f2a-db16536258e3", "tag": "62b3e7a3-0978-4f57-a2ab-7e3928be96f1"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:33.927809 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ace95c9a-254a-45f0-b343-4308ae0248fc req-06344561-68f8-4572-b1ad-11202a257f5d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:33.928239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ace95c9a-254a-45f0-b343-4308ae0248fc req-06344561-68f8-4572-b1ad-11202a257f5d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:33.940274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-ace95c9a-254a-45f0-b343-4308ae0248fc req-06344561-68f8-4572-b1ad-11202a257f5d service nova] Creating event network-changed:62b3e7a3-0978-4f57-a2ab-7e3928be96f1 for instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 on hv-cinder-85084 Jul 26 03:13:33.945146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-ace95c9a-254a-45f0-b343-4308ae0248fc req-06344561-68f8-4572-b1ad-11202a257f5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032514 Jul 26 03:13:33.945741 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 206/400] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:34.036213 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:34.044965 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:34.046770 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:34.048806 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-51d1f113-afe4-4e16-9793-511c127cef25 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.200752 Jul 26 03:13:34.051095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 195/401] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:33 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:34.945664 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-6a9a484d-b534-4036-8c23-76f66291f9db req-09458864-c51b-467e-b66d-4afa5d92964f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634ce020-f329-4f42-aca0-d419ac3ba613", "name": "network-vif-plugged", "status": "completed", "tag": "b87353fe-7737-4250-b95a-0e1027d7987e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:34.956724 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6a9a484d-b534-4036-8c23-76f66291f9db req-09458864-c51b-467e-b66d-4afa5d92964f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:34.957292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-6a9a484d-b534-4036-8c23-76f66291f9db req-09458864-c51b-467e-b66d-4afa5d92964f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:34.968650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-6a9a484d-b534-4036-8c23-76f66291f9db req-09458864-c51b-467e-b66d-4afa5d92964f service nova] Creating event network-vif-plugged:b87353fe-7737-4250-b95a-0e1027d7987e for instance 634ce020-f329-4f42-aca0-d419ac3ba613 on hv-cinder-85084 Jul 26 03:13:34.973855 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-6a9a484d-b534-4036-8c23-76f66291f9db req-09458864-c51b-467e-b66d-4afa5d92964f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032859 Jul 26 03:13:34.974451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 207/402] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:35.072477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:35.073076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:35.080287 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:35.081001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:35.081774 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:35.082171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:35.217981 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:35.226577 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:35.228160 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:35.229317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d579eba0-1e82-4a48-8325-0699b3496b46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.160800 Jul 26 03:13:35.229874 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 196/403] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:35 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:36.258465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:36.259510 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:36.268684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:36.269123 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:36.269876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:36.270300 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:36.404161 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:36.414553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:36.416067 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:36.417223 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b24593bf-e9b6-4ea8-8546-3acf9f8b43dc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.166955 Jul 26 03:13:36.417773 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 208/404] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:36 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:37.440362 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:37.441155 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:37.448464 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:37.449168 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:37.449935 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:37.450376 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:37.585324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:37.594431 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:37.595969 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:37.597236 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-56d33376-f4ad-48f0-a2e1-e98ed7e242e1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1807 microversion: 2.20 time: 0.161019 Jul 26 03:13:37.597796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 197/405] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:37 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:38.624896 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:38.625907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:38.637114 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:38.637961 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:38.639229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:38.639991 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:38.765822 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:38.774382 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:38.775895 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:38.777046 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f86d666e-055d-4dbe-98e4-d5cc9cacc475 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1794 microversion: 2.20 time: 0.158835 Jul 26 03:13:38.777605 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 209/406] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:13:38 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:13:40.989005 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7151c259-6f15-45f5-8eec-0f74e4fb5185 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18fefe2b-f8bd-46ce-b9b8-e50f12740b75"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:40.991467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7151c259-6f15-45f5-8eec-0f74e4fb5185 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:40.993791 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=70 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:40.999289 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7151c259-6f15-45f5-8eec-0f74e4fb5185 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:40.999865 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7151c259-6f15-45f5-8eec-0f74e4fb5185 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:41.000647 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7151c259-6f15-45f5-8eec-0f74e4fb5185 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:41.001075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7151c259-6f15-45f5-8eec-0f74e4fb5185 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:41.024768 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:41.272599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7151c259-6f15-45f5-8eec-0f74e4fb5185 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287821 Jul 26 03:13:41.273229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 198/407] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:13:40 2022] POST /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:48.864061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:48.866346 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:48.868742 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=15 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:48.869394 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=85 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:13:48.875613 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:48.876054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:48.876807 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:48.877420 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:48.900139 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lazy-loading 'flavor' on Instance uuid d7920448-33e8-41f5-bba8-1bb9e4ba6399 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:13:49.038004 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3a9dfab0-52ff-4d3a-8dc6-3b45ff181ee9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/action" status: 200 len: 32 microversion: 2.1 time: 0.177940 Jul 26 03:13:49.038608 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 210/408] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:13:48 2022] POST /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:13:49.049522 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:49.050210 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:49.056721 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:49.057170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:49.057925 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:49.058360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:49.268916 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:49.277509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0b32c593-6149-4a00-b037-085359408d7e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.233009 Jul 26 03:13:49.278088 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 199/409] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:49 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:50.305311 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:50.306329 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:50.316312 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:50.316756 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:50.317514 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:50.317944 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:50.446826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:50.455263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-15924c11-f215-46c9-89d5-c3c8877fdbed tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.158248 Jul 26 03:13:50.455937 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 211/410] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:50 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:51.481413 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:51.482355 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:51.491049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:51.491491 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:51.492242 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:51.492667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:51.642606 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:51.651057 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1e20a93a-573d-442b-8a41-32712ddd13e0 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.176144 Jul 26 03:13:51.651614 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 200/411] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:51 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:52.676867 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:52.678100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:52.689126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:52.689995 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:52.690747 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:52.691210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:53.072596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:53.081625 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c8a6f111-3003-46a7-996c-f2a1a0782c7f tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.411263 Jul 26 03:13:53.082215 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 212/412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:52 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:54.087124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3a53a45a-50f3-4928-8329-88e1c626a990 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:54.087849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3a53a45a-50f3-4928-8329-88e1c626a990 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:54.100235 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a53a45a-50f3-4928-8329-88e1c626a990 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.101683 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a53a45a-50f3-4928-8329-88e1c626a990 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.103060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a53a45a-50f3-4928-8329-88e1c626a990 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.103799 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3a53a45a-50f3-4928-8329-88e1c626a990 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.105166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:54.106138 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:54.115989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.116548 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.117484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.118099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.135543 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3a53a45a-50f3-4928-8329-88e1c626a990 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5/ips" status: 200 len: 150 microversion: 2.1 time: 0.057007 Jul 26 03:13:54.136629 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 201/413] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:13:54 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:54.148215 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2475f64-e6e5-47b8-97fd-a4eb8ed57b82"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:54.150667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:54.156988 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.157431 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.158180 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.158605 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.237581 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Invalid volume: volume e2475f64-e6e5-47b8-97fd-a4eb8ed57b82 is already attached to instances: 32e66410-316a-4d20-a6f8-c248fb10a534 Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: POST /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5/os-volume_attachments HTTP/1.1 Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 74 Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:13:54.239344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {"volumeAttachment": {"volumeId": "e2475f64-e6e5-47b8-97fd-a4eb8ed57b82"}} Jul 26 03:13:54.241157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Invalid volume: volume e2475f64-e6e5-47b8-97fd-a4eb8ed57b82 is already attached to instances: 32e66410-316a-4d20-a6f8-c248fb10a534 Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'server_id': 'd09c4f22-568d-47e5-85e7-0df4402648a5', 'body': {'volumeAttachment': {'volumeId': 'e2475f64-e6e5-47b8-97fd-a4eb8ed57b82'}}} Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e2475f64-e6e5-47b8-97fd-a4eb8ed57b82 is already attached to instances: 32e66410-316a-4d20-a6f8-c248fb10a534 Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:54.242025 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e2475f64-e6e5-47b8-97fd-a4eb8ed57b82 is already attached to instances: 32e66410-316a-4d20-a6f8-c248fb10a534 Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:13:54.243501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e2475f64-e6e5-47b8-97fd-a4eb8ed57b82 is already attached to instances: 32e66410-316a-4d20-a6f8-c248fb10a534 Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 400 to user: Invalid volume: volume e2475f64-e6e5-47b8-97fd-a4eb8ed57b82 is already attached to instances: 32e66410-316a-4d20-a6f8-c248fb10a534 {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a3bec60d-b809-4f02-8875-33d7d5c2212d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096589 Jul 26 03:13:54.244885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 202/414] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:13:54 2022] POST /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 03:13:54.249582 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:54.250076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:54.252998 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:54.257030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.257475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.258241 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.258671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.263403 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c80a3d45-c13c-4c94-8fb8-b7efff4e21cc tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.163606 Jul 26 03:13:54.264009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 213/415] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:54 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:54.283534 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:13:54.361920 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-aeb893ac-8ff7-4e93-bee0-f1088b0ce291 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 204 len: 0 microversion: 2.1 time: 0.115453 Jul 26 03:13:54.362846 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 203/416] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:13:54 2022] DELETE /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 03:13:54.373356 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:54.373946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:54.380415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.380854 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.381606 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:54.382029 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:54.518606 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:54.526548 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ac37a14b-cbf7-49fe-936e-552d3df571b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1682 microversion: 2.1 time: 0.158740 Jul 26 03:13:54.527122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 214/417] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:54 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:55.285538 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:55.286163 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:55.293228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:55.293674 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:55.294439 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:55.294868 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:55.436056 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:55.444760 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d66de4c0-93d7-4a76-b7fe-fc6864b4a2a7 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.163644 Jul 26 03:13:55.445325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 204/418] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:55 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:55.553278 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:55.554157 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:55.565324 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:55.566071 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:55.567407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:55.568196 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:55.706140 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:55.717433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-507836c4-f0e9-481e-9b22-9c7aaf5ed835 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1682 microversion: 2.1 time: 0.170488 Jul 26 03:13:55.718166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 215/419] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:55 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:56.466030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:56.467265 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:56.473864 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:56.474307 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:56.475065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:56.475484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:56.733731 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:56.741637 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:56.742249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:56.743042 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-197ecc1f-e020-4760-9446-6a5e31146705 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.280695 Jul 26 03:13:56.743894 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 205/420] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:56 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:56.755535 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:56.756582 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:56.758799 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:56.759270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:56.825770 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:56.835246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-90198b0c-2ece-4659-b788-aab24044984a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 200 len: 1614 microversion: 2.1 time: 0.097343 Jul 26 03:13:56.835897 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 216/421] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:56 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:13:56.917715 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-9f0e4efc-09eb-455b-a744-dc01864127da req-3bfa401f-c45b-4d31-887d-2dddd517c394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09c4f22-568d-47e5-85e7-0df4402648a5", "name": "network-vif-deleted", "tag": "a2e79be8-72eb-4197-ab48-b9e19b2869db"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:13:56.931660 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-9f0e4efc-09eb-455b-a744-dc01864127da req-3bfa401f-c45b-4d31-887d-2dddd517c394 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:56.932098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-9f0e4efc-09eb-455b-a744-dc01864127da req-3bfa401f-c45b-4d31-887d-2dddd517c394 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:56.947961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-9f0e4efc-09eb-455b-a744-dc01864127da req-3bfa401f-c45b-4d31-887d-2dddd517c394 service nova] Creating event network-vif-deleted:a2e79be8-72eb-4197-ab48-b9e19b2869db for instance d09c4f22-568d-47e5-85e7-0df4402648a5 on hv-cinder-85084 Jul 26 03:13:56.957537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-9f0e4efc-09eb-455b-a744-dc01864127da req-3bfa401f-c45b-4d31-887d-2dddd517c394 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043531 Jul 26 03:13:56.958503 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 206/422] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:57.764958 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:57.765821 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:57.773302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:57.773886 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:57.774904 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:57.775734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:57.857408 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:57.858135 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:57.868027 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:57.868472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:57.869210 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:57.869638 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:57.909150 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 HTTP/1.1 Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:13:57.913367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:13:57.914630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'd09c4f22-568d-47e5-85e7-0df4402648a5'} Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:13:57.915390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:13:57.920377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:13:57.921458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:13:57.921458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7e837177-a150-4443-96c0-b80ad707e8e2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 404 len: 111 microversion: 2.1 time: 0.061937 Jul 26 03:13:57.921458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 207/423] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:57 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:13:57.933146 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3666bffd-2390-49fd-b9a7-793d7aacbaec tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '.version_select at 0x7f5f79a92790>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:57.955529 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3666bffd-2390-49fd-b9a7-793d7aacbaec tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115067543" status: 202 len: 0 microversion: 2.1 time: 0.030308 Jul 26 03:13:57.956947 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 208/424] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Jul 26 03:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115067543 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:13:57.960909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:57.969475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4ec419ec-bbf1-40a5-b9ba-868ce960d0a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.208663 Jul 26 03:13:57.970201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 217/425] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:57 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:13:58.677630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:58.678127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:58.685385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:58.685835 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:58.686598 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:58.687072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:58.819518 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lazy-loading 'services' on Instance uuid 32e66410-316a-4d20-a6f8-c248fb10a534 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:13:58.945783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9d0a535d-13f5-4f36-8d03-433a28f71642 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments/e2475f64-e6e5-47b8-97fd-a4eb8ed57b82" status: 202 len: 0 microversion: 2.1 time: 0.270503 Jul 26 03:13:58.946451 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 209/426] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:13:58 2022] DELETE /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments/e2475f64-e6e5-47b8-97fd-a4eb8ed57b82 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:13:58.955657 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bdf70f7c-751c-490b-b4d0-c5cc053eaf80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:58.958162 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bdf70f7c-751c-490b-b4d0-c5cc053eaf80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:58.964996 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdf70f7c-751c-490b-b4d0-c5cc053eaf80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:58.965431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdf70f7c-751c-490b-b4d0-c5cc053eaf80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:58.966173 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdf70f7c-751c-490b-b4d0-c5cc053eaf80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:58.966769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdf70f7c-751c-490b-b4d0-c5cc053eaf80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:58.992739 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:13:58.993546 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:13:59.002354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:59.002354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:59.003130 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:13:59.003270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bdf70f7c-751c-490b-b4d0-c5cc053eaf80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051358 Jul 26 03:13:59.004081 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:13:59.004199 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 218/427] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:13:58 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:13:59.137332 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:13:59.145618 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a6cba621-c99b-469a-bb6e-09d6c31ed859 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.157325 Jul 26 03:13:59.146179 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 210/428] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:13:58 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:14:00.016308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-38c1da16-c7e7-497f-811d-e97b106aba94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:00.018458 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-38c1da16-c7e7-497f-811d-e97b106aba94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:00.025474 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-38c1da16-c7e7-497f-811d-e97b106aba94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.025933 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-38c1da16-c7e7-497f-811d-e97b106aba94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.026694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-38c1da16-c7e7-497f-811d-e97b106aba94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.027154 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-38c1da16-c7e7-497f-811d-e97b106aba94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.056204 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-38c1da16-c7e7-497f-811d-e97b106aba94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043941 Jul 26 03:14:00.056755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 219/429] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:14:00 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:14:00.119115 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:00.119696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:00.126422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.126863 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.127665 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.128091 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.152519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:14:00.167686 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:00.168312 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:00.174781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.175247 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.176035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.176465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.230629 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f22daf6b-780b-48a6-97cf-7c5d6eff9c75 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 204 len: 0 microversion: 2.1 time: 0.115006 Jul 26 03:14:00.231374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 211/430] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:14:00 2022] DELETE /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:14:00.240661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:00.241341 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:00.247739 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.248180 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.248927 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:00.249347 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:00.268202 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:00.314089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:00.323499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d5746e79-754f-439f-bba2-f7b85dae38d5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.159779 Jul 26 03:14:00.324088 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 220/431] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:00 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:14:00.393179 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:00.401156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4d829b63-6dfd-43f7-b74a-896911afb8db tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1681 microversion: 2.1 time: 0.164905 Jul 26 03:14:00.401733 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 212/432] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:00 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:01.349475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:01.350443 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:01.361669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:01.362421 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:01.363701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:01.364402 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:01.422031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:01.422596 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:01.429559 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:01.430007 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:01.430796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:01.431253 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:01.495795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:01.504022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-65f55fb5-2107-45be-a129-9c2a9f402219 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.161000 Jul 26 03:14:01.504596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 221/433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:01 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:01.558071 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:01.565795 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a7278024-6e57-4339-8ce0-ea592a5bd580 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1681 microversion: 2.1 time: 0.147732 Jul 26 03:14:01.566354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 213/434] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:01 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:02.525480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:02.526094 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:02.532971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:02.533415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:02.534164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:02.534572 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:02.587923 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:02.588656 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:02.596634 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:02.597076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:02.597843 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:02.598387 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:02.678666 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:02.686757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-997d2a6c-f9d8-4f62-9a92-9407f1b5fd50 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.165263 Jul 26 03:14:02.687346 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 222/435] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:02 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:02.690438 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:02.697965 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a5ccb3eb-6661-48ec-9564-d62645589de5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 200 len: 1615 microversion: 2.1 time: 0.114137 Jul 26 03:14:02.698512 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 214/436] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:02 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 1615 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:02.876533 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-b3fc55c0-eaf6-4405-83fe-e910b650cdbf req-7b50f1f2-9b2f-4608-a0d3-4fb8e9b83b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32e66410-316a-4d20-a6f8-c248fb10a534", "name": "network-vif-deleted", "tag": "65c2f70b-d12f-49c9-8a17-b9a3a5a002cb"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:02.897105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-b3fc55c0-eaf6-4405-83fe-e910b650cdbf req-7b50f1f2-9b2f-4608-a0d3-4fb8e9b83b57 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:02.897724 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-b3fc55c0-eaf6-4405-83fe-e910b650cdbf req-7b50f1f2-9b2f-4608-a0d3-4fb8e9b83b57 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:02.911787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-b3fc55c0-eaf6-4405-83fe-e910b650cdbf req-7b50f1f2-9b2f-4608-a0d3-4fb8e9b83b57 service nova] Creating event network-vif-deleted:65c2f70b-d12f-49c9-8a17-b9a3a5a002cb for instance 32e66410-316a-4d20-a6f8-c248fb10a534 on hv-cinder-85084 Jul 26 03:14:02.917150 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-b3fc55c0-eaf6-4405-83fe-e910b650cdbf req-7b50f1f2-9b2f-4608-a0d3-4fb8e9b83b57 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044750 Jul 26 03:14:02.921226 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 223/437] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:03.711510 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:03.712099 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:03.719069 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:03.719573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:03.720343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:03.720771 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:03.721745 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:03.722461 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:03.729166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:03.729654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:03.730425 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:03.730856 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:03.746055 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 HTTP/1.1 Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:14:03.747766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:14:03.749361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '32e66410-316a-4d20-a6f8-c248fb10a534'} Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:14:03.750232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:14:03.751647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:03.753631 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:14:03.754485 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7528da9c-558e-4a80-ae3d-c46d860e84e8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 404 len: 111 microversion: 2.1 time: 0.038422 Jul 26 03:14:03.758365 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 224/438] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:03 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 03:14:03.764260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-04c3b581-0189-4b7f-b8a7-a920c0f2d2ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '.version_select at 0x7f5f7979cee0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:03.786384 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-04c3b581-0189-4b7f-b8a7-a920c0f2d2ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872523297" status: 202 len: 0 microversion: 2.1 time: 0.026560 Jul 26 03:14:03.787338 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 225/439] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Jul 26 03:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1872523297 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 03:14:03.861260 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:03.871360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8c67560f-5c32-4f86-9881-3c63bddbfcfa tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.165597 Jul 26 03:14:03.871950 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 215/440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:03 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:04.447950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6e7722e9-50d3-4b40-a581-83d8a22776eb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: .version_select at 0x7f5f7966e1f0>, body: {"keypair": {"name": "tempest-keypair-1318805699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdiRD/4KqSl0YsiJ1Sv9czF06PYJZ4+8sdon4g2lekUKwZUqpsjA52OW4ltXot5OCWCMGiqyICsGud9+KO3NYiyDCj/kuTXvu5ULvZZXurV+AC9DFt2Y01G6XzlpcyLLw=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:04.464659 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-6e7722e9-50d3-4b40-a581-83d8a22776eb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:14:04.468458 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-6e7722e9-50d3-4b40-a581-83d8a22776eb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:14:04.492256 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6e7722e9-50d3-4b40-a581-83d8a22776eb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048278 Jul 26 03:14:04.492858 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 226/441] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:14:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:04.896830 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:04.897936 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:04.905014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:04.905245 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:04.906213 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:04.906650 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:05.135475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:05.143984 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0f0566ed-e783-4bbe-b18f-ba0e7399ca91 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.254863 Jul 26 03:14:05.144556 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 216/442] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:04 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:05.885306 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-137336501", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f744be8-1146-4ad7-825e-8d297f751ced"}], "security_groups": [{"name": "tempest-securitygroup--965322595"}], "key_name": "tempest-keypair-1318805699", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:05.989099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] validate_networks() for [('3f744be8-1146-4ad7-825e-8d297f751ced', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:14:06.166313 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:06.166914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:06.173399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:06.174162 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:06.174937 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:06.175586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:06.368866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:14:06.369277 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:14:06.369733 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:14:06.370311 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:14:06.370856 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:14:06.380962 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:06.381404 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:06.382381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:06.382804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:06.400388 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:14:06.404602 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:14:06.416232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:14:06.418550 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:14:06.471045 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4ac49da6-1213-49d4-a38a-fa803491585d tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590499 Jul 26 03:14:06.472081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 227/443] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:14:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:14:06.483067 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ceb96528-f9db-47cb-b877-9ab2a1d01def tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:06.483654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ceb96528-f9db-47cb-b877-9ab2a1d01def tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:06.544171 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ceb96528-f9db-47cb-b877-9ab2a1d01def tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:06.554163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ceb96528-f9db-47cb-b877-9ab2a1d01def tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1241 microversion: 2.1 time: 0.074736 Jul 26 03:14:06.555526 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 228/444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:06 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:14:06.607378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:06.615380 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-55fac444-4fe7-4bd1-943b-eb7411e66574 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.453419 Jul 26 03:14:06.615954 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 217/445] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:06 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:14:07.575998 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:07.576538 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:07.583555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:07.583997 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:07.584774 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:07.585231 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:07.604446 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:07.636930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:07.637515 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:07.644022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:07.644466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:07.645240 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:07.645661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:07.649684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:07.657384 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3549e4a5-41f0-4154-998c-f3f9b0313c21 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1293 microversion: 2.1 time: 0.085782 Jul 26 03:14:07.657920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 229/446] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:07 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:07.776917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:07.789203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0d95ec46-aaba-4272-bbf2-0726e7407f8a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1735 microversion: 2.1 time: 0.155834 Jul 26 03:14:07.790084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 218/447] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:07 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:08.677937 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:08.678531 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:08.685987 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:08.686081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:08.686766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:08.687526 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:08.749577 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:08.757554 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-76084659-0bc6-4ea8-bb79-f8c7c1b5c700 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1299 microversion: 2.1 time: 0.083537 Jul 26 03:14:08.758123 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 230/448] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:08 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:08.811756 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:08.812281 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:08.818981 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:08.819445 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:08.820268 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:08.820735 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.037687 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:09.047239 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-324d96cb-9305-475a-a944-2c8612b03296 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1715 microversion: 2.1 time: 0.239810 Jul 26 03:14:09.047852 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 219/449] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:08 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1715 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:09.159838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:09.160329 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:09.166714 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.167224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.168170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.168375 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.301407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] HTTP exception thrown: Cannot 'detach_volume' instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 while it is in vm_state rescued Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Request method failure captured: Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments/18fefe2b-f8bd-46ce-b9b8-e50f12740b75 HTTP/1.1 Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31szcB1UDzQ9ihgT3Wm9ngfiYKq9a8Wjpdg0C8yLdhowMTHw1KbffvbYec_leHviylPxQox_uESlrlvdkNnUYoB4GAXZ6lVVXK1vzbkNpo96jnHure3qgNMXaWEm_C0Nw7ZW3vrnpESEfAaexI4TmG5RdUjWyOO7anPohn0GnayjLe4 Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:14:09.303249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 1a1125811ba549e0ae66b26ad3949f23 Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:14:09.304746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Cannot 'detach_volume' instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 while it is in vm_state rescued Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'server_id': 'd7920448-33e8-41f5-bba8-1bb9e4ba6399', 'id': '18fefe2b-f8bd-46ce-b9b8-e50f12740b75'} Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:14:09.305586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 while it is in vm_state rescued Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 while it is in vm_state rescued Jul 26 03:14:09.306923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:09.308701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Returning 409 to user: Cannot 'detach_volume' instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 while it is in vm_state rescued {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:14:09.309566 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0bb18b97-f46a-49bc-9c5d-b30ac3690cb8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments/18fefe2b-f8bd-46ce-b9b8-e50f12740b75" status: 409 len: 152 microversion: 2.1 time: 0.153813 Jul 26 03:14:09.310144 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 231/450] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:14:09 2022] DELETE /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments/18fefe2b-f8bd-46ce-b9b8-e50f12740b75 => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 03:14:09.318791 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9a2c92f1-27bf-4b4c-892c-e56faa2af6e2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:09.319419 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9a2c92f1-27bf-4b4c-892c-e56faa2af6e2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:09.331378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a2c92f1-27bf-4b4c-892c-e56faa2af6e2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.332081 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a2c92f1-27bf-4b4c-892c-e56faa2af6e2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.333045 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a2c92f1-27bf-4b4c-892c-e56faa2af6e2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.333472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a2c92f1-27bf-4b4c-892c-e56faa2af6e2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.406934 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9a2c92f1-27bf-4b4c-892c-e56faa2af6e2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "POST /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/action" status: 202 len: 0 microversion: 2.1 time: 0.092003 Jul 26 03:14:09.410871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 220/451] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:14:09 2022] POST /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:14:09.416155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:09.416766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:09.425693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.426243 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.427242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.427829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.677020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:09.686266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e02b066d-9cc3-4410-9e7b-8e416dfc64c9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1723 microversion: 2.1 time: 0.274089 Jul 26 03:14:09.687019 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 232/452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:09 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:09.778329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:09.779054 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:09.796340 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.797001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:09.797964 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:09.798596 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:10.025189 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:10.034552 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fb26854b-abf4-429e-a31c-6d7beef8e1a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.260438 Jul 26 03:14:10.035624 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 221/453] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:09 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:10.109279 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-b3ecbaf6-135d-4374-8b02-81c2213f37ab req-3a82132d-04e2-4cd4-999a-00feca9a7232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606", "tag": "8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:10.122468 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-b3ecbaf6-135d-4374-8b02-81c2213f37ab req-3a82132d-04e2-4cd4-999a-00feca9a7232 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:10.122933 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-b3ecbaf6-135d-4374-8b02-81c2213f37ab req-3a82132d-04e2-4cd4-999a-00feca9a7232 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:10.135414 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-b3ecbaf6-135d-4374-8b02-81c2213f37ab req-3a82132d-04e2-4cd4-999a-00feca9a7232 service nova] Creating event network-changed:8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6 for instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 on hv-cinder-85084 Jul 26 03:14:10.140711 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-b3ecbaf6-135d-4374-8b02-81c2213f37ab req-3a82132d-04e2-4cd4-999a-00feca9a7232 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035868 Jul 26 03:14:10.141306 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 233/454] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:10.711703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:10.712679 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:10.724744 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:10.725553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:10.726776 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:10.727528 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:10.869102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:10.877655 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c28954a0-30c7-42e5-a60e-37ce2958afa8 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1723 microversion: 2.1 time: 0.172457 Jul 26 03:14:10.878220 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 222/455] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:10 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:11.057463 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:11.058409 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:11.067387 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:11.067975 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:11.068959 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:11.069526 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:11.207440 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:11.217069 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d7735846-7e08-4a57-9efa-a5e4b2071e5e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.164366 Jul 26 03:14:11.217637 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 234/456] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:11 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:11.898836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:11.899687 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:11.902341 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:11.908531 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:11.908947 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:11.909746 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:11.910173 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:12.042266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:12.050438 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-2a730b7c-1e8d-4efa-bfe9-085055c443c4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1723 microversion: 2.1 time: 0.155536 Jul 26 03:14:12.051023 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 223/457] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:11 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:12.245282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:12.246085 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:12.257227 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:12.257980 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:12.259284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:12.259961 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:12.402304 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:12.413315 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fd1e8c66-2fd1-401d-9607-e675e128b50a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.174668 Jul 26 03:14:12.414085 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 235/458] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:12 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:13.074362 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:13.075336 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:13.082591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:13.083066 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:13.083820 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:13.084246 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:13.228169 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:13.238708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bacc3173-6c42-4821-9ed2-d2e769156286 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1729 microversion: 2.1 time: 0.169847 Jul 26 03:14:13.239301 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 224/459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:13 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:13.261728 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d9647657-e79d-4487-82e3-03fbea6ec7df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:13.262224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d9647657-e79d-4487-82e3-03fbea6ec7df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:13.269792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9647657-e79d-4487-82e3-03fbea6ec7df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:13.270379 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9647657-e79d-4487-82e3-03fbea6ec7df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:13.271562 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9647657-e79d-4487-82e3-03fbea6ec7df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:13.272204 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9647657-e79d-4487-82e3-03fbea6ec7df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:13.349423 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d9647657-e79d-4487-82e3-03fbea6ec7df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091555 Jul 26 03:14:13.350024 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 236/460] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:14:13 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:13.433996 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:13.434598 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:13.441073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:13.441495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:13.442248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:13.442678 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:13.691826 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:13.699507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-778c47db-4055-4e3b-ad5e-ce4bac45041c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.269458 Jul 26 03:14:13.700442 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 225/461] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:13 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:14.321236 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0d24cffa-eeeb-41e0-90eb-276b47f59adb req-30651e6b-e6ed-4335-b62d-d548b6024a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7920448-33e8-41f5-bba8-1bb9e4ba6399", "tag": "00d6395a-b67a-4403-9103-923b188e56a9"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:14.333804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0d24cffa-eeeb-41e0-90eb-276b47f59adb req-30651e6b-e6ed-4335-b62d-d548b6024a62 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:14.334316 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0d24cffa-eeeb-41e0-90eb-276b47f59adb req-30651e6b-e6ed-4335-b62d-d548b6024a62 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:14.345817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0d24cffa-eeeb-41e0-90eb-276b47f59adb req-30651e6b-e6ed-4335-b62d-d548b6024a62 service nova] Creating event network-changed:00d6395a-b67a-4403-9103-923b188e56a9 for instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 on hv-cinder-85084 Jul 26 03:14:14.351151 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0d24cffa-eeeb-41e0-90eb-276b47f59adb req-30651e6b-e6ed-4335-b62d-d548b6024a62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034151 Jul 26 03:14:14.352106 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 237/462] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:14.721352 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:14.722628 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:14.729499 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:14.729943 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:14.730731 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:14.731182 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:14.945028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:14.953872 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7860220f-8348-404a-9ece-30d037464480 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.236268 Jul 26 03:14:14.954370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 226/463] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:14 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:15.979649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:15.980637 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:15.987391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:15.987831 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:15.988594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:15.989048 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:16.131960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:16.139993 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b709d0e2-2827-4536-a0ac-88738b4c0a80 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.168227 Jul 26 03:14:16.140575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 238/464] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:15 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:16.365702 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-fafc7195-9b08-4d7f-b63a-9420d25340ed req-91b4d3f6-4288-4ec6-b43f-41d75a3edb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7920448-33e8-41f5-bba8-1bb9e4ba6399", "tag": "00d6395a-b67a-4403-9103-923b188e56a9"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:16.376462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-fafc7195-9b08-4d7f-b63a-9420d25340ed req-91b4d3f6-4288-4ec6-b43f-41d75a3edb64 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:16.376907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-fafc7195-9b08-4d7f-b63a-9420d25340ed req-91b4d3f6-4288-4ec6-b43f-41d75a3edb64 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:16.388608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-fafc7195-9b08-4d7f-b63a-9420d25340ed req-91b4d3f6-4288-4ec6-b43f-41d75a3edb64 service nova] Creating event network-changed:00d6395a-b67a-4403-9103-923b188e56a9 for instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 on hv-cinder-85084 Jul 26 03:14:16.393895 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-fafc7195-9b08-4d7f-b63a-9420d25340ed req-91b4d3f6-4288-4ec6-b43f-41d75a3edb64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031946 Jul 26 03:14:16.394507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 227/465] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:16.603108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:16.603727 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:16.606894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:16.607908 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=12 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:16.615812 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:16.616275 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:16.617090 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:16.617513 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:16.702160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lazy-loading 'services' on Instance uuid c517b5ca-379c-4830-bc26-021ce1412c76 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:14:16.824178 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7cb5d505-de1a-4d15-9d57-8c1550738299 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-volume_attachments/252d01fa-9514-4776-b604-e357c63af876" status: 202 len: 0 microversion: 2.1 time: 0.225520 Jul 26 03:14:16.825145 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 239/466] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:14:16 2022] DELETE /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-volume_attachments/252d01fa-9514-4776-b604-e357c63af876 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:14:17.161204 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:17.162144 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:17.168798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:17.169230 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:17.169984 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:17.170409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:17.189905 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-55c2d06b-f913-4814-a09e-eaf8f8c58472 req-9f903146-122d-49b6-8a1d-b5b43fdd3ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606", "name": "network-vif-plugged", "status": "completed", "tag": "8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:17.201143 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-55c2d06b-f913-4814-a09e-eaf8f8c58472 req-9f903146-122d-49b6-8a1d-b5b43fdd3ebf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:17.201575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-55c2d06b-f913-4814-a09e-eaf8f8c58472 req-9f903146-122d-49b6-8a1d-b5b43fdd3ebf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:17.213444 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-55c2d06b-f913-4814-a09e-eaf8f8c58472 req-9f903146-122d-49b6-8a1d-b5b43fdd3ebf service nova] Creating event network-vif-plugged:8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6 for instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 on hv-cinder-85084 Jul 26 03:14:17.218539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-55c2d06b-f913-4814-a09e-eaf8f8c58472 req-9f903146-122d-49b6-8a1d-b5b43fdd3ebf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033294 Jul 26 03:14:17.219163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 240/467] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:17.344731 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:17.348578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:17.353547 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-655104a0-7bdb-40ef-ac5b-498d1539724c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.196780 Jul 26 03:14:17.360086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 228/468] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:17 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:17.947854 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-69c087b7-442e-4709-97f0-c8bec9834c65 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:17.955174 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-69c087b7-442e-4709-97f0-c8bec9834c65 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:17.955610 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-69c087b7-442e-4709-97f0-c8bec9834c65 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:17.979646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-69c087b7-442e-4709-97f0-c8bec9834c65 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Going to try to stop instance {{(pid=118060) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 03:14:18.025531 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-69c087b7-442e-4709-97f0-c8bec9834c65 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action" status: 202 len: 0 microversion: 2.1 time: 0.081576 Jul 26 03:14:18.026357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 241/469] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:14:17 2022] POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:14:18.034918 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:18.035537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:18.043346 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:18.043825 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:18.044717 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:18.045140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:18.176451 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:18.184674 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-523661d4-fc05-41da-b834-d8ac972ddcd3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.153597 Jul 26 03:14:18.185246 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 229/470] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:18 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:18.386478 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:18.387698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:18.394596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:18.395057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:18.395804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:18.396225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:18.532099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:18.543485 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-816565c6-c594-4b5c-9c90-cf6f5b0b62a7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1366 microversion: 2.1 time: 0.164584 Jul 26 03:14:18.544246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 242/471] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:18 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:19.211266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:19.212268 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:19.220571 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:19.221060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:19.221832 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:19.222242 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:19.363775 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:19.374334 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ce513b50-b7dd-4633-83ba-3c7165aceb2f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.169928 Jul 26 03:14:19.374915 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 230/472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:19 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:19.569167 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:19.570229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:19.574278 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:19.580707 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:19.581171 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:19.581922 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:19.582342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:19.726556 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:19.734365 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-24436015-3171-4dda-b8ab-6ebc84fa28df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1556 microversion: 2.1 time: 0.171864 Jul 26 03:14:19.734985 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 243/473] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:19 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:19.754620 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4f671e29-126f-44c0-8216-540dc7cf32b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:19.755152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4f671e29-126f-44c0-8216-540dc7cf32b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:19.761252 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f671e29-126f-44c0-8216-540dc7cf32b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:19.761697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f671e29-126f-44c0-8216-540dc7cf32b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:19.762452 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f671e29-126f-44c0-8216-540dc7cf32b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:19.762879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f671e29-126f-44c0-8216-540dc7cf32b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:19.839973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4f671e29-126f-44c0-8216-540dc7cf32b7 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089239 Jul 26 03:14:19.840568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 231/474] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:14:19 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:20.395754 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:20.396361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:20.402449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:20.402892 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:20.403720 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:20.404149 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:20.533947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:20.542097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2faa53fc-f818-47e1-842e-37d44dd650ad tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.150211 Jul 26 03:14:20.542712 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 244/475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:20 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:20.803330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-85677834-1112-457d-9be0-047406c943bd req-c027f7d4-7fcb-4d90-8dd5-57baa4ae11b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606", "tag": "8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:20.813852 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-85677834-1112-457d-9be0-047406c943bd req-c027f7d4-7fcb-4d90-8dd5-57baa4ae11b9 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:20.814332 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-85677834-1112-457d-9be0-047406c943bd req-c027f7d4-7fcb-4d90-8dd5-57baa4ae11b9 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:20.826350 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-85677834-1112-457d-9be0-047406c943bd req-c027f7d4-7fcb-4d90-8dd5-57baa4ae11b9 service nova] Creating event network-changed:8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6 for instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 on hv-cinder-85084 Jul 26 03:14:20.831432 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-85677834-1112-457d-9be0-047406c943bd req-c027f7d4-7fcb-4d90-8dd5-57baa4ae11b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032357 Jul 26 03:14:20.832040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 232/476] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:21.047835 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b17bd379-c0d1-4613-b7b1-795c32fd6a46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:21.049273 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b17bd379-c0d1-4613-b7b1-795c32fd6a46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:21.057302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b17bd379-c0d1-4613-b7b1-795c32fd6a46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.058025 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b17bd379-c0d1-4613-b7b1-795c32fd6a46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.059210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b17bd379-c0d1-4613-b7b1-795c32fd6a46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.059870 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b17bd379-c0d1-4613-b7b1-795c32fd6a46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.091319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b17bd379-c0d1-4613-b7b1-795c32fd6a46 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments/13b2f9bb-8417-46ed-8b06-f2b3e1aa4fe0" status: 200 len: 194 microversion: 2.20 time: 0.047729 Jul 26 03:14:21.091899 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 245/477] 10.222.0.42 () {60 vars in 1454 bytes} [Tue Jul 26 03:14:21 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments/13b2f9bb-8417-46ed-8b06-f2b3e1aa4fe0 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:14:21.168670 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:21.169316 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:21.175741 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.176355 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.176953 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.177398 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.271014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lazy-loading 'services' on Instance uuid 634ce020-f329-4f42-aca0-d419ac3ba613 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:14:21.350369 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ee4f9258-6cf9-4731-950b-d7b4b18cfbf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments/13b2f9bb-8417-46ed-8b06-f2b3e1aa4fe0" status: 202 len: 0 microversion: 2.20 time: 0.185863 Jul 26 03:14:21.351331 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 233/478] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Jul 26 03:14:21 2022] DELETE /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments/13b2f9bb-8417-46ed-8b06-f2b3e1aa4fe0 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:14:21.367631 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-36954890-f227-4440-a11e-608f6abf25b7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:21.370721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-36954890-f227-4440-a11e-608f6abf25b7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:21.381655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36954890-f227-4440-a11e-608f6abf25b7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.382415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36954890-f227-4440-a11e-608f6abf25b7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.384200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36954890-f227-4440-a11e-608f6abf25b7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.385164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36954890-f227-4440-a11e-608f6abf25b7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.417398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:21.423290 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-36954890-f227-4440-a11e-608f6abf25b7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067554 Jul 26 03:14:21.424484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 246/479] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Jul 26 03:14:21 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:14:21.564590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:21.565279 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:21.572176 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.572625 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.573388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:21.573816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:21.715129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:21.722790 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3e35d582-859c-4b84-82a0-d30d34811dfb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.162547 Jul 26 03:14:21.723385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 234/480] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:21 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:22.436454 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-843d8b94-ec15-4798-8029-bd2c043e217d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:22.438761 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-843d8b94-ec15-4798-8029-bd2c043e217d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:22.446414 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-843d8b94-ec15-4798-8029-bd2c043e217d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.446852 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-843d8b94-ec15-4798-8029-bd2c043e217d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.447638 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-843d8b94-ec15-4798-8029-bd2c043e217d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.448085 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-843d8b94-ec15-4798-8029-bd2c043e217d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.478576 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-843d8b94-ec15-4798-8029-bd2c043e217d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046181 Jul 26 03:14:22.479159 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 247/481] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Jul 26 03:14:22 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:22.545524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:22.546029 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:22.553271 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.553755 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.554528 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.555026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.582785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:14:22.662816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-efdc6308-40b8-4bc2-9e62-f7898dcb4c7f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 204 len: 0 microversion: 2.20 time: 0.122783 Jul 26 03:14:22.663528 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 235/482] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Jul 26 03:14:22 2022] DELETE /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 03:14:22.671773 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:22.672338 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:22.678583 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.679049 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.679805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.680229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.745069 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:22.745831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:22.753146 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.753575 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.754427 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:22.754858 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:22.822736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:22.831442 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:22.832941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:22.834100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c36d7f62-a3bf-487b-9587-50dafdab2726 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.166364 Jul 26 03:14:22.834674 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 248/483] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:22 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:22.885605 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:22.893385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c312d297-2cac-4c66-a89d-9ecd95491f9d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.152815 Jul 26 03:14:22.893964 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 236/484] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:22 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:23.860627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:23.861607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:23.872816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:23.873256 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:23.874014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:23.874437 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:23.914992 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:23.915631 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:23.922361 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:23.922812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:23.923606 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:23.924026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:24.005724 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:24.014343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:24.015791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:24.016969 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0ad443e7-8bbe-4b3a-936b-8be9659d624d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1722 microversion: 2.20 time: 0.162899 Jul 26 03:14:24.017520 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 249/485] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:23 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:24.056871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:24.064626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1f9cfd67-c8bd-4ae7-a0da-17e56c7e9f23 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.153451 Jul 26 03:14:24.065150 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 237/486] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:23 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:25.039170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:25.040327 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:25.053601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:25.054249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:25.056878 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:25.057617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:25.087621 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:25.090493 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:25.097274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:25.097727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:25.098474 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:25.098894 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:25.122062 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:25.130508 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:25.132276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:25.133631 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8fa5ba5f-382b-4243-bec5-5e573895681d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 200 len: 1656 microversion: 2.20 time: 0.098572 Jul 26 03:14:25.134188 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 250/487] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:25 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 1656 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:25.310325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:25.318235 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3afe4662-e060-4c48-baf2-f931f8807bca tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.235778 Jul 26 03:14:25.318723 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 238/488] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:25 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:25.386870 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-4f243089-d619-4b95-9ab4-af40afcee85b req-c742d9de-741c-4aff-9d12-3ed4996c6820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "634ce020-f329-4f42-aca0-d419ac3ba613", "name": "network-vif-deleted", "tag": "b87353fe-7737-4250-b95a-0e1027d7987e"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:25.396906 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4f243089-d619-4b95-9ab4-af40afcee85b req-c742d9de-741c-4aff-9d12-3ed4996c6820 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:25.397608 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-4f243089-d619-4b95-9ab4-af40afcee85b req-c742d9de-741c-4aff-9d12-3ed4996c6820 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:25.413691 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-4f243089-d619-4b95-9ab4-af40afcee85b req-c742d9de-741c-4aff-9d12-3ed4996c6820 service nova] Creating event network-vif-deleted:b87353fe-7737-4250-b95a-0e1027d7987e for instance 634ce020-f329-4f42-aca0-d419ac3ba613 on hv-cinder-85084 Jul 26 03:14:25.419377 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-4f243089-d619-4b95-9ab4-af40afcee85b req-c742d9de-741c-4aff-9d12-3ed4996c6820 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035999 Jul 26 03:14:25.420594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 251/489] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:26.156872 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:26.157452 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:26.164452 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:26.164900 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:26.165669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:26.166095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:26.179871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] HTTP exception thrown: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Request method failure captured: Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 HTTP/1.1 Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31s2DJLaZkwVrDL_3gJg-gcmuBCKukBMvBU-rJVlUt4aOTILRHcZ2en__so-5zFgBkFovtQM9uF2wcPUaudzE8N67CN25k3WjRGZ2RjZ2CMupAF8aMpquD0MfYN1f7lYJ_LJwx44omwbM-L6JbLieuXvES8wSLQMQV8avIszasAWfXY Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:14:26.181785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 037c9f8229a44de198ebc3752f7a1966 Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:14:26.183248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '634ce020-f329-4f42-aca0-d419ac3ba613'} Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:14:26.184008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:14:26.185283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:14:26.186331 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Returning 404 to user: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:14:26.186331 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c8ee8e2a-78d9-4a57-9555-90f4cb8a314e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 404 len: 111 microversion: 2.20 time: 0.030429 Jul 26 03:14:26.186331 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 239/490] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:26 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:14:26.193569 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f7633c47-faeb-498a-939f-2506f1d7d617 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '.version_select at 0x7f5f79615430>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:26.214763 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f7633c47-faeb-498a-939f-2506f1d7d617 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866725568" status: 204 len: 0 microversion: 2.20 time: 0.025894 Jul 26 03:14:26.215610 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 252/491] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Jul 26 03:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866725568 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 03:14:26.341299 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:26.342041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:26.349194 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:26.349739 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:26.350935 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:26.351520 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:26.626176 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:26.634691 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-62ba0bdf-d103-42f4-a82a-31925df7cae8 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.298339 Jul 26 03:14:26.635296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 240/492] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:26 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:26.940177 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d299b015-8bde-4be9-914d-64bdff94020b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'create', calling method: .version_select at 0x7f5f79a4df70>, body: {"keypair": {"name": "tempest-keypair-1380810819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPltFKn1uy5IFKI9zgfLG62OhKpiWRgoh0BbTCrNkF4SGCP0jdZ/Y0jxY62fQ5h8vADzyfsBm1Ohizm9lbMuHrMSPQIwsMQDoJSK38HoqNDoEkPR5MGLukDlQ46MQlF17w=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:26.956962 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d299b015-8bde-4be9-914d-64bdff94020b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for project ab741435041940cc9c7f02b27120bd90. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:14:26.961063 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d299b015-8bde-4be9-914d-64bdff94020b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for user 037c9f8229a44de198ebc3752f7a1966 and project ab741435041940cc9c7f02b27120bd90. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:14:26.988450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d299b015-8bde-4be9-914d-64bdff94020b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052032 Jul 26 03:14:26.989261 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 253/493] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Jul 26 03:14:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 03:14:27.657184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:27.657786 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:27.664196 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:27.664641 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:27.665394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:27.665823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:28.109099 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:28.117389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d361fecf-acf7-4350-9de7-2a3603c78f87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1677 microversion: 2.1 time: 0.464063 Jul 26 03:14:28.131058 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 241/494] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:27 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1677 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:28.664978 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-831779356", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4264094-c280-4d22-bc2f-c5a07efc0e99"}], "security_groups": [{"name": "tempest-securitygroup--919640998"}], "key_name": "tempest-keypair-1380810819", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:28.769282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] validate_networks() for [('e4264094-c280-4d22-bc2f-c5a07efc0e99', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:14:29.139500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:29.140105 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:29.148467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:29.148976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:29.150306 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:29.150886 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:29.163908 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:14:29.164325 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:14:29.164789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:14:29.165191 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:14:29.165594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:14:29.175125 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:29.175592 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:29.176460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:29.176921 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:29.195893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for project ab741435041940cc9c7f02b27120bd90. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:14:29.201345 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Getting quotas for user 037c9f8229a44de198ebc3752f7a1966 and project ab741435041940cc9c7f02b27120bd90. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:14:29.213322 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:14:29.215806 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:14:29.264415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-48371f46-8ef0-4cbb-9472-e1db0366a5f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.604995 Jul 26 03:14:29.271446 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 254/495] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Jul 26 03:14:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 03:14:29.277193 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-33703892-cf1e-4b8b-a5de-1ebd892d126b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:29.277808 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-33703892-cf1e-4b8b-a5de-1ebd892d126b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:29.290615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:29.298547 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1c427839-78c3-4d89-ad9f-637bd1890494 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1654 microversion: 2.1 time: 0.162964 Jul 26 03:14:29.314077 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 242/496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:29 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:29.320766 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-53c8a185-9e47-463c-9646-0fbd59604735 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:29.327672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53c8a185-9e47-463c-9646-0fbd59604735 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:29.328129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53c8a185-9e47-463c-9646-0fbd59604735 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:29.334868 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-33703892-cf1e-4b8b-a5de-1ebd892d126b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:29.343202 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-33703892-cf1e-4b8b-a5de-1ebd892d126b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:29.345232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-33703892-cf1e-4b8b-a5de-1ebd892d126b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:29.346052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-33703892-cf1e-4b8b-a5de-1ebd892d126b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1281 microversion: 2.20 time: 0.073023 Jul 26 03:14:29.346886 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 255/497] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:29 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:14:29.351199 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-53c8a185-9e47-463c-9646-0fbd59604735 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Going to try to start instance {{(pid=118059) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 03:14:29.386707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:29.396291 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-53c8a185-9e47-463c-9646-0fbd59604735 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action" status: 202 len: 0 microversion: 2.1 time: 0.079284 Jul 26 03:14:29.396994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 243/498] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:14:29 2022] POST /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 03:14:29.405318 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:29.405928 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:29.412705 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:29.413202 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:29.413931 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:29.414407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:29.560668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:29.570506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e92a206a-248a-4200-a436-0121a50cb4a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1663 microversion: 2.1 time: 0.169122 Jul 26 03:14:29.571124 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 256/499] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:29 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:14:30.370401 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:30.371136 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:30.378081 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:30.378524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:30.379330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:30.379764 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:30.445667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:30.454678 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:30.456383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:30.457613 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b78a4c4f-f2b0-4955-a400-d14f6b036b2d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1351 microversion: 2.20 time: 0.092769 Jul 26 03:14:30.458215 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 244/500] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:30 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:30.592687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:30.593356 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:30.600102 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:30.600551 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:30.601321 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:30.601753 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:30.788125 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:30.796184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8b61c034-dda2-47f2-bdcb-4f47da272a0a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1663 microversion: 2.1 time: 0.207633 Jul 26 03:14:30.796760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 257/501] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:30 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1663 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:31.481392 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:31.482127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:31.489393 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:31.489831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:31.490597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:31.491032 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:31.636578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:31.645510 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:31.647040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:31.648198 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5afae27c-7b3e-457b-83b8-6a5c83af622b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1406 microversion: 2.20 time: 0.170926 Jul 26 03:14:31.648758 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 245/502] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:31 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:31.818822 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:31.819740 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:31.828891 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:31.829521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:31.830536 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:31.831160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:32.024804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:32.032564 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-da2af009-fe36-4eab-b3ba-2beb754c32a3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1667 microversion: 2.1 time: 0.218737 Jul 26 03:14:32.033359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 258/503] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:31 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1667 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:32.133143 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-df28a66a-c965-48c4-a37f-cbff0fd80c77 req-8053eb00-a763-48b0-9137-328dc04c0279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe0d48e-9b52-48e2-bf40-30f16f2fd37d", "tag": "9bba44c6-edd4-430c-95db-d19a412c48e7"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:32.144849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-df28a66a-c965-48c4-a37f-cbff0fd80c77 req-8053eb00-a763-48b0-9137-328dc04c0279 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:32.145562 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-df28a66a-c965-48c4-a37f-cbff0fd80c77 req-8053eb00-a763-48b0-9137-328dc04c0279 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:32.164292 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-df28a66a-c965-48c4-a37f-cbff0fd80c77 req-8053eb00-a763-48b0-9137-328dc04c0279 service nova] Creating event network-changed:9bba44c6-edd4-430c-95db-d19a412c48e7 for instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d on hv-cinder-85084 Jul 26 03:14:32.169823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-df28a66a-c965-48c4-a37f-cbff0fd80c77 req-8053eb00-a763-48b0-9137-328dc04c0279 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040280 Jul 26 03:14:32.170800 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 246/504] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:32.674898 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:32.675939 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:32.685911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:32.686355 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:32.687151 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:32.687578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:32.827979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:32.836718 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:32.838262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:32.839396 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ef419af4-e877-49bb-98cf-adbaebd1bb96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1406 microversion: 2.20 time: 0.171064 Jul 26 03:14:32.839957 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 259/505] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:32 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:33.865298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:33.865950 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:33.872578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:33.873024 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:33.873775 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:33.874201 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:34.007908 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:34.015972 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:34.017442 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:34.018533 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-075ab7ee-d37f-4196-8035-9879d9e0b415 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1406 microversion: 2.20 time: 0.158719 Jul 26 03:14:34.019157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 247/506] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:33 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:35.041182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:35.041787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:35.048877 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:35.049323 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:35.050081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:35.050512 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:35.181781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:35.190013 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:35.191538 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:35.193055 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1fca88a4-9b2b-4ece-8f54-033f6aee01f5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1406 microversion: 2.20 time: 0.155520 Jul 26 03:14:35.193559 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 260/507] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:35 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:36.219599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:36.220599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:36.231745 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:36.232195 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:36.232960 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:36.233386 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:36.365965 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:36.377084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:36.379318 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:36.380943 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-2a9d8a49-7941-4280-be05-de3f9d99b729 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1406 microversion: 2.20 time: 0.167786 Jul 26 03:14:36.381741 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 248/508] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:36 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:37.224903 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-2150e625-16a1-4e91-aea5-1a0fe74cb6dd req-bb1bf1fb-82de-46ea-a141-cd6e9570a772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0d48e-9b52-48e2-bf40-30f16f2fd37d", "name": "network-vif-plugged", "status": "completed", "tag": "9bba44c6-edd4-430c-95db-d19a412c48e7"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:37.235591 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2150e625-16a1-4e91-aea5-1a0fe74cb6dd req-bb1bf1fb-82de-46ea-a141-cd6e9570a772 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:37.236030 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-2150e625-16a1-4e91-aea5-1a0fe74cb6dd req-bb1bf1fb-82de-46ea-a141-cd6e9570a772 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:37.247182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-2150e625-16a1-4e91-aea5-1a0fe74cb6dd req-bb1bf1fb-82de-46ea-a141-cd6e9570a772 service nova] Creating event network-vif-plugged:9bba44c6-edd4-430c-95db-d19a412c48e7 for instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d on hv-cinder-85084 Jul 26 03:14:37.252311 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-2150e625-16a1-4e91-aea5-1a0fe74cb6dd req-bb1bf1fb-82de-46ea-a141-cd6e9570a772 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031119 Jul 26 03:14:37.253018 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 261/509] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:37.405907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:37.407176 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:37.413573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:37.414031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:37.414790 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:37.415240 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:37.550191 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:37.562424 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:37.564705 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:37.566279 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7aa9318f-8d3a-476a-8c36-fe17c4249b81 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1406 microversion: 2.20 time: 0.164249 Jul 26 03:14:37.567030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 249/510] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:37 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:38.595131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:38.596247 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:38.607142 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:38.607865 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:38.608636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:38.609059 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:38.751211 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:38.759242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:38.760730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:38.761840 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f25abf5a-4064-470f-bfac-e98b483f4edc tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1406 microversion: 2.20 time: 0.174686 Jul 26 03:14:38.762374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 262/511] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:38 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:39.789309 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:39.790325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:39.799809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:39.800212 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:39.800951 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:39.801401 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:39.931464 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:39.944636 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:39.946642 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:39.948431 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8070c4d5-08a8-41ef-8526-df2ece66cc48 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1598 microversion: 2.20 time: 0.166272 Jul 26 03:14:39.949600 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 250/512] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:14:39 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:14:39.972728 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6c42093e-9c06-42d9-9216-209d6c74edeb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:39.973261 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6c42093e-9c06-42d9-9216-209d6c74edeb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:39.975256 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:39.975943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=12 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:39.982284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6c42093e-9c06-42d9-9216-209d6c74edeb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:39.982729 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6c42093e-9c06-42d9-9216-209d6c74edeb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:39.983518 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6c42093e-9c06-42d9-9216-209d6c74edeb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:39.983954 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6c42093e-9c06-42d9-9216-209d6c74edeb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:40.062076 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6c42093e-9c06-42d9-9216-209d6c74edeb tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092906 Jul 26 03:14:40.062708 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 263/513] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Jul 26 03:14:39 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:14:40.990913 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-54828768-b2c6-4c97-ac1e-b6a93a01c406 req-3d85969e-db4f-47fd-b166-e2d9f22a77a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe0d48e-9b52-48e2-bf40-30f16f2fd37d", "tag": "9bba44c6-edd4-430c-95db-d19a412c48e7"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:41.001321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-54828768-b2c6-4c97-ac1e-b6a93a01c406 req-3d85969e-db4f-47fd-b166-e2d9f22a77a8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:41.001761 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-54828768-b2c6-4c97-ac1e-b6a93a01c406 req-3d85969e-db4f-47fd-b166-e2d9f22a77a8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:41.013202 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-54828768-b2c6-4c97-ac1e-b6a93a01c406 req-3d85969e-db4f-47fd-b166-e2d9f22a77a8 service nova] Creating event network-changed:9bba44c6-edd4-430c-95db-d19a412c48e7 for instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d on hv-cinder-85084 Jul 26 03:14:41.018683 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-54828768-b2c6-4c97-ac1e-b6a93a01c406 req-3d85969e-db4f-47fd-b166-e2d9f22a77a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031530 Jul 26 03:14:41.019326 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 251/514] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:52.132720 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:52.133569 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=70 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:52.137770 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:52.138249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:52.146313 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:52.146772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:52.147551 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:52.147975 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:52.228166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lazy-loading 'services' on Instance uuid d7920448-33e8-41f5-bba8-1bb9e4ba6399 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:14:52.312690 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-91fa9435-1335-4eb3-b345-ef22cf42d831 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments/18fefe2b-f8bd-46ce-b9b8-e50f12740b75" status: 202 len: 0 microversion: 2.1 time: 0.180987 Jul 26 03:14:52.313416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 264/515] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:14:52 2022] DELETE /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments/18fefe2b-f8bd-46ce-b9b8-e50f12740b75 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:14:52.319981 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:52.320727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=40 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:14:52.325597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-634d6bb7-cf30-4db5-bfd0-0ffed948a918 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:52.327871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-634d6bb7-cf30-4db5-bfd0-0ffed948a918 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:52.335621 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-634d6bb7-cf30-4db5-bfd0-0ffed948a918 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:52.336061 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-634d6bb7-cf30-4db5-bfd0-0ffed948a918 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:52.336894 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-634d6bb7-cf30-4db5-bfd0-0ffed948a918 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:52.337332 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-634d6bb7-cf30-4db5-bfd0-0ffed948a918 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:52.368590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-634d6bb7-cf30-4db5-bfd0-0ffed948a918 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050213 Jul 26 03:14:52.369128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 252/516] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:14:52 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:53.386596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-98431e29-c365-4cd3-a827-e71235ec66b5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:53.390407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-98431e29-c365-4cd3-a827-e71235ec66b5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:53.397887 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98431e29-c365-4cd3-a827-e71235ec66b5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:53.398328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98431e29-c365-4cd3-a827-e71235ec66b5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:53.399122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98431e29-c365-4cd3-a827-e71235ec66b5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:53.399550 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-98431e29-c365-4cd3-a827-e71235ec66b5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:53.428757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-98431e29-c365-4cd3-a827-e71235ec66b5 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049577 Jul 26 03:14:53.429242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 265/517] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:14:53 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:14:53.504045 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:53.504667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:53.511228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:53.511645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:53.512390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:53.512813 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:53.538189 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:14:53.623372 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-25f96343-2bf2-4812-975f-899d04c7e941 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 204 len: 0 microversion: 2.1 time: 0.122831 Jul 26 03:14:53.623952 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 253/518] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:14:53 2022] DELETE /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:14:53.632477 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:53.633117 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:53.639387 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:53.639826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:53.640581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:53.641007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:53.780406 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:53.788385 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-95151c53-e4a7-4f42-838e-0f1493023ae4 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1689 microversion: 2.1 time: 0.159756 Jul 26 03:14:53.788920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 266/519] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:53 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:54.810891 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:54.811622 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:54.818456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:54.818916 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:54.819704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:54.820135 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:54.959213 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:54.967301 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8c6f1a52-152f-4683-b1e7-568e654597c2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1689 microversion: 2.1 time: 0.161186 Jul 26 03:14:54.967881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 254/520] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:54 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:55.992739 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:55.993710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:56.003465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:56.003911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:56.004670 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:56.005093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:56.142241 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:56.153832 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fc4045d0-5ede-4c13-8e82-8fe3394da530 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1689 microversion: 2.1 time: 0.167289 Jul 26 03:14:56.154607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 267/521] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:55 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:57.177523 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:57.178139 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:57.185266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:57.185716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:57.186471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:57.186901 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:57.340282 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:57.348541 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-104e01f9-11cd-4e0f-ac64-2277c2e1db7d tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1689 microversion: 2.1 time: 0.175018 Jul 26 03:14:57.349107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 255/522] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:57 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:58.369804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:58.370543 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:58.377362 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:58.378074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:58.378836 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:58.379305 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:58.448758 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:14:58.457126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1a0a988f-3c6c-48e1-b19e-3810e2e597df tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 200 len: 1622 microversion: 2.1 time: 0.091203 Jul 26 03:14:58.457913 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 268/523] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:58 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 1622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:14:58.630887 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-7ed6314a-f27a-4e8c-a8ae-ca3e8956a981 req-d85d1d38-7042-4f4e-830b-d737b3846bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7920448-33e8-41f5-bba8-1bb9e4ba6399", "name": "network-vif-deleted", "tag": "00d6395a-b67a-4403-9103-923b188e56a9"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:14:58.643594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-7ed6314a-f27a-4e8c-a8ae-ca3e8956a981 req-d85d1d38-7042-4f4e-830b-d737b3846bdd service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:58.644522 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-7ed6314a-f27a-4e8c-a8ae-ca3e8956a981 req-d85d1d38-7042-4f4e-830b-d737b3846bdd service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:58.656881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-7ed6314a-f27a-4e8c-a8ae-ca3e8956a981 req-d85d1d38-7042-4f4e-830b-d737b3846bdd service nova] Creating event network-vif-deleted:00d6395a-b67a-4403-9103-923b188e56a9 for instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 on hv-cinder-85084 Jul 26 03:14:58.662872 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-7ed6314a-f27a-4e8c-a8ae-ca3e8956a981 req-d85d1d38-7042-4f4e-830b-d737b3846bdd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035604 Jul 26 03:14:58.663984 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 256/524] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:14:59.478032 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:59.478674 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: d7920448-33e8-41f5-bba8-1bb9e4ba6399] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:14:59.486040 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:59.486497 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:59.487373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:14:59.487828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:14:59.502436 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] HTTP exception thrown: Instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 could not be found. Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Request method failure captured: Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 HTTP/1.1 Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31szcB1UDzQ9ihgT3Wm9ngfiYKq9a8Wjpdg0C8yLdhowMTHw1KbffvbYec_leHviylPxQox_uESlrlvdkNnUYoB4GAXZ6lVVXK1vzbkNpo96jnHure3qgNMXaWEm_C0Nw7ZW3vrnpESEfAaexI4TmG5RdUjWyOO7anPohn0GnayjLe4 Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:14:59.504155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 1a1125811ba549e0ae66b26ad3949f23 Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 could not be found. Jul 26 03:14:59.505676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'd7920448-33e8-41f5-bba8-1bb9e4ba6399'} Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 could not be found. Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:14:59.506419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 could not be found. Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 could not be found. Jul 26 03:14:59.507645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:14:59.508717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Returning 404 to user: Instance d7920448-33e8-41f5-bba8-1bb9e4ba6399 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:14:59.508717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-75983dec-3053-4ce5-921d-defcc67ec8a2 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399" status: 404 len: 111 microversion: 2.1 time: 0.031497 Jul 26 03:14:59.508717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 269/525] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:14:59 2022] GET /compute/v2.1/servers/d7920448-33e8-41f5-bba8-1bb9e4ba6399 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:14:59.515552 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-47dec054-c298-4e19-9ab7-ec85815d626e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '.version_select at 0x7f5f795bd550>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:14:59.536783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-47dec054-c298-4e19-9ab7-ec85815d626e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958253522" status: 202 len: 0 microversion: 2.1 time: 0.025608 Jul 26 03:14:59.537697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 257/526] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Jul 26 03:14:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958253522 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:15:02.458547 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:02.459121 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:02.466205 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:02.466654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:02.467439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:02.467860 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:02.493045 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:15:02.572711 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1c687223-071b-4c73-ac3a-ce22308a6dc9 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 204 len: 0 microversion: 2.1 time: 0.117791 Jul 26 03:15:02.573331 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 270/527] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:15:02 2022] DELETE /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:15:02.582738 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:02.583474 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:02.589703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:02.590143 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:02.590910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:02.591365 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:02.722329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:02.730232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3d209b80-04f6-47e0-8ff8-704cc044c03a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1507 microversion: 2.1 time: 0.152097 Jul 26 03:15:02.730795 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 258/528] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:02 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:03.756506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:03.757695 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:03.767823 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:03.768272 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:03.769033 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:03.769456 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:03.902046 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:03.913697 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-52fa454d-ba82-4709-93af-714b84582653 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1507 microversion: 2.1 time: 0.164093 Jul 26 03:15:03.914412 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 271/529] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:03 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:04.611128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5dde5af6-997f-4476-93c9-a7c451ae287c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:04.611749 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5dde5af6-997f-4476-93c9-a7c451ae287c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:04.619365 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5dde5af6-997f-4476-93c9-a7c451ae287c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:04.619865 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5dde5af6-997f-4476-93c9-a7c451ae287c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:04.620711 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5dde5af6-997f-4476-93c9-a7c451ae287c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:04.621192 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5dde5af6-997f-4476-93c9-a7c451ae287c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:04.646329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5dde5af6-997f-4476-93c9-a7c451ae287c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/ips" status: 200 len: 149 microversion: 2.1 time: 0.041304 Jul 26 03:15:04.646885 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 259/530] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:15:04 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:04.938108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:04.938768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:04.945739 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:04.946185 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:04.946975 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:04.947406 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:05.080093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:05.087857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5d84fabf-f35d-4c6d-9aa3-e0dd38a14f06 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1507 microversion: 2.1 time: 0.154076 Jul 26 03:15:05.088411 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 272/531] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:04 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:05.572703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-e60d3c26-7b51-4889-8e6f-1d8128f3263f req-ae9d85a4-eb53-44f6-99fc-711b1772b36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f971d9b5-56d0-41d3-96be-3d84cb6ac42d", "name": "network-vif-deleted", "tag": "b6099887-557b-4566-a536-eecde3f944bc"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:05.588719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-e60d3c26-7b51-4889-8e6f-1d8128f3263f req-ae9d85a4-eb53-44f6-99fc-711b1772b36a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:05.589390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-e60d3c26-7b51-4889-8e6f-1d8128f3263f req-ae9d85a4-eb53-44f6-99fc-711b1772b36a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:05.602918 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-e60d3c26-7b51-4889-8e6f-1d8128f3263f req-ae9d85a4-eb53-44f6-99fc-711b1772b36a service nova] Creating event network-vif-deleted:b6099887-557b-4566-a536-eecde3f944bc for instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d on hv-cinder-85084 Jul 26 03:15:05.609358 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-e60d3c26-7b51-4889-8e6f-1d8128f3263f req-ae9d85a4-eb53-44f6-99fc-711b1772b36a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040783 Jul 26 03:15:05.609976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 260/532] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:05.999530 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f6333533-8e01-4185-b8d9-10fa6b29a7cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce097458-7829-42ec-8847-c0d6907b818b"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:06.001948 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f6333533-8e01-4185-b8d9-10fa6b29a7cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:06.008147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6333533-8e01-4185-b8d9-10fa6b29a7cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:06.008600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6333533-8e01-4185-b8d9-10fa6b29a7cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:06.009379 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6333533-8e01-4185-b8d9-10fa6b29a7cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:06.009810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f6333533-8e01-4185-b8d9-10fa6b29a7cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:06.109467 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:06.110241 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:06.117455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:06.117904 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:06.118668 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:06.119153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:06.154887 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:06.155337 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:06.156536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lazy-loading 'fault' on Instance uuid f971d9b5-56d0-41d3-96be-3d84cb6ac42d {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:15:06.204405 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:06.212527 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a7cec7f9-ffcb-4fda-bf46-224947572c09 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 200 len: 1312 microversion: 2.1 time: 0.107577 Jul 26 03:15:06.213089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 261/533] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:06 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:06.269500 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f6333533-8e01-4185-b8d9-10fa6b29a7cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275449 Jul 26 03:15:06.270235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 273/534] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:15:05 2022] POST /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:07.236263 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:07.236836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: f971d9b5-56d0-41d3-96be-3d84cb6ac42d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:07.243831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:07.244269 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:07.245030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:07.245457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:07.259478 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] HTTP exception thrown: Instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d could not be found. Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Request method failure captured: Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d HTTP/1.1 Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31szcB1UDzQ9ihgT3Wm9ngfiYKq9a8Wjpdg0C8yLdhowMTHw1KbffvbYec_leHviylPxQox_uESlrlvdkNnUYoB4GAXZ6lVVXK1vzbkNpo96jnHure3qgNMXaWEm_C0Nw7ZW3vrnpESEfAaexI4TmG5RdUjWyOO7anPohn0GnayjLe4 Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:15:07.261184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 1a1125811ba549e0ae66b26ad3949f23 Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d could not be found. Jul 26 03:15:07.262762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'f971d9b5-56d0-41d3-96be-3d84cb6ac42d'} Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d could not be found. Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:15:07.263823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d could not be found. Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d could not be found. Jul 26 03:15:07.265710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:07.267014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Returning 404 to user: Instance f971d9b5-56d0-41d3-96be-3d84cb6ac42d could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:15:07.267014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-19d4c957-0781-435f-9dbf-85435643c234 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d" status: 404 len: 111 microversion: 2.1 time: 0.031930 Jul 26 03:15:07.267014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 262/535] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:07 2022] GET /compute/v2.1/servers/f971d9b5-56d0-41d3-96be-3d84cb6ac42d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:15:07.272642 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:07.273244 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:07.279735 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:07.280192 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:07.280925 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:07.281347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:07.305891 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:15:07.391430 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b12cef19-ced3-4579-ac2d-c927227a1588 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "DELETE /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 204 len: 0 microversion: 2.1 time: 0.117820 Jul 26 03:15:07.391430 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 274/536] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:15:07 2022] DELETE /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 03:15:07.396943 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:07.397577 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:07.403927 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:07.404392 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:07.405143 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:07.405564 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:07.541518 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:07.549490 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-81ccb925-6780-4716-a8a0-5bd5bffbe075 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.158412 Jul 26 03:15:07.550082 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 263/537] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:07 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:08.575484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:08.576633 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:08.585322 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:08.585774 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:08.586536 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:08.586973 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:08.729763 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:08.733336 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:08.738020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b4e03f4b-aca1-4107-b0e3-cd5dcad61404 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.170058 Jul 26 03:15:08.738584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 275/538] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:08 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:09.763542 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:09.764518 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:09.775013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:09.775759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:09.777008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:09.777722 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:09.924506 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:09.936291 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1217f495-c25b-4c80-9ee0-15156573b567 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.179025 Jul 26 03:15:09.937145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 264/539] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:09 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:10.958378 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:10.959009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:10.966033 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:10.966469 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:10.967252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:10.967677 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:11.144303 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:11.152363 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a690a854-27ea-48de-ac96-8c965031650e tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1522 microversion: 2.1 time: 0.198375 Jul 26 03:15:11.152965 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 276/540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:10 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:11.351637 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-e869b964-d16d-43a6-84b6-1ec32df9401a req-c230b519-5e40-4eac-8607-c6258b674e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b2fd31-c308-474f-93fa-f83ffc0cf95f", "name": "network-vif-deleted", "tag": "8c749033-d963-446a-8db6-a53a1ffff8ef"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:11.362743 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-e869b964-d16d-43a6-84b6-1ec32df9401a req-c230b519-5e40-4eac-8607-c6258b674e5e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:11.363280 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-e869b964-d16d-43a6-84b6-1ec32df9401a req-c230b519-5e40-4eac-8607-c6258b674e5e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:11.375080 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-e869b964-d16d-43a6-84b6-1ec32df9401a req-c230b519-5e40-4eac-8607-c6258b674e5e service nova] Creating event network-vif-deleted:8c749033-d963-446a-8db6-a53a1ffff8ef for instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f on hv-cinder-85084 Jul 26 03:15:11.380344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-e869b964-d16d-43a6-84b6-1ec32df9401a req-c230b519-5e40-4eac-8607-c6258b674e5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032441 Jul 26 03:15:11.381250 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 265/541] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:12.177027 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:12.178027 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:12.188945 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:12.189692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:12.190937 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:12.191965 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:12.224584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:12.225024 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:12.225471 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lazy-loading 'fault' on Instance uuid 19b2fd31-c308-474f-93fa-f83ffc0cf95f {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:15:12.270308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1125811ba549e0ae66b26ad3949f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07cd1888316403eb9c37610a310b76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:12.277255 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7bb269d8-3a74-4afe-88b8-9e2f71ffe838 tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 200 len: 1312 microversion: 2.1 time: 0.106875 Jul 26 03:15:12.277817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 277/542] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:12 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:13.299455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:13.300106 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] [instance: 19b2fd31-c308-474f-93fa-f83ffc0cf95f] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:13.307005 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.307468 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.308220 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.308702 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.322243 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] HTTP exception thrown: Instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f could not be found. Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Request method failure captured: Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f HTTP/1.1 Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31szcB1UDzQ9ihgT3Wm9ngfiYKq9a8Wjpdg0C8yLdhowMTHw1KbffvbYec_leHviylPxQox_uESlrlvdkNnUYoB4GAXZ6lVVXK1vzbkNpo96jnHure3qgNMXaWEm_C0Nw7ZW3vrnpESEfAaexI4TmG5RdUjWyOO7anPohn0GnayjLe4 Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:15:13.324232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a07cd1888316403eb9c37610a310b76d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: a07cd1888316403eb9c37610a310b76d Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-497160387 Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 1a1125811ba549e0ae66b26ad3949f23 Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-ServerRescueNegativeTestJSON-497160387-project Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f could not be found. Jul 26 03:15:13.325615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '19b2fd31-c308-474f-93fa-f83ffc0cf95f'} Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f could not be found. Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:15:13.326310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f could not be found. Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f could not be found. Jul 26 03:15:13.327553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.328745 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] Returning 404 to user: Instance 19b2fd31-c308-474f-93fa-f83ffc0cf95f could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:15:13.328745 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-68b8ee8a-de48-43cb-aeb0-fe286fedee1a tempest-ServerRescueNegativeTestJSON-497160387 tempest-ServerRescueNegativeTestJSON-497160387-project] 10.222.0.42 "GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f" status: 404 len: 111 microversion: 2.1 time: 0.031367 Jul 26 03:15:13.328745 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 266/543] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:13 2022] GET /compute/v2.1/servers/19b2fd31-c308-474f-93fa-f83ffc0cf95f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:15:13.403697 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-94254504-ca74-4c5c-b617-e9e36e6340ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:13.405949 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-94254504-ca74-4c5c-b617-e9e36e6340ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:13.412903 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94254504-ca74-4c5c-b617-e9e36e6340ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.413324 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94254504-ca74-4c5c-b617-e9e36e6340ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.414134 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94254504-ca74-4c5c-b617-e9e36e6340ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.414522 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94254504-ca74-4c5c-b617-e9e36e6340ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.447451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-94254504-ca74-4c5c-b617-e9e36e6340ae tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047622 Jul 26 03:15:13.448217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 278/544] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:15:13 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:15:13.513011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:13.513501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:13.519986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.520715 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.521595 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.522030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.547636 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:15:13.623091 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f72ffd1b-1497-4115-9027-2a5403b28d56 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 204 len: 0 microversion: 2.1 time: 0.113707 Jul 26 03:15:13.623969 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 267/545] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:15:13 2022] DELETE /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:15:13.634058 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:13.634669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:13.640803 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.641475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.642372 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.642804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.775778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:13.797521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b87dfaa5-cbbd-4891-8b70-10dedbfedf86 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1673 microversion: 2.1 time: 0.168764 Jul 26 03:15:13.798250 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 279/546] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:13 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:13.855203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce097458-7829-42ec-8847-c0d6907b818b"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:13.857614 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:13.863699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.864137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.864889 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:13.865463 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:13.944847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Invalid volume: volume ce097458-7829-42ec-8847-c0d6907b818b is already attached to instances: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: POST /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments HTTP/1.1 Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 74 Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:15:13.946590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {"volumeAttachment": {"volumeId": "ce097458-7829-42ec-8847-c0d6907b818b"}} Jul 26 03:15:13.948133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Invalid volume: volume ce097458-7829-42ec-8847-c0d6907b818b is already attached to instances: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'server_id': 'a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606', 'body': {'volumeAttachment': {'volumeId': 'ce097458-7829-42ec-8847-c0d6907b818b'}}} Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce097458-7829-42ec-8847-c0d6907b818b is already attached to instances: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.949390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce097458-7829-42ec-8847-c0d6907b818b is already attached to instances: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:13.950727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce097458-7829-42ec-8847-c0d6907b818b is already attached to instances: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 400 to user: Invalid volume: volume ce097458-7829-42ec-8847-c0d6907b818b is already attached to instances: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9ed80bfd-0386-4bde-84a2-720e04a906f2 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097491 Jul 26 03:15:13.952089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 268/547] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:15:13 2022] POST /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:15:14.019292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:14.019778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:14.026071 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:14.026459 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:14.027257 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:14.027679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:14.109032 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lazy-loading 'services' on Instance uuid a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:15:14.182668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-31148baa-610b-4aa9-b9cf-c9f1e435bcbb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments/ce097458-7829-42ec-8847-c0d6907b818b" status: 202 len: 0 microversion: 2.1 time: 0.167620 Jul 26 03:15:14.187713 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 280/548] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:15:14 2022] DELETE /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments/ce097458-7829-42ec-8847-c0d6907b818b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:15:14.193457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1c5063ca-3c31-4b8f-8793-dd6eb46436fa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:14.196050 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1c5063ca-3c31-4b8f-8793-dd6eb46436fa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:14.202832 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c5063ca-3c31-4b8f-8793-dd6eb46436fa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:14.203423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c5063ca-3c31-4b8f-8793-dd6eb46436fa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:14.204223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c5063ca-3c31-4b8f-8793-dd6eb46436fa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:14.204651 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c5063ca-3c31-4b8f-8793-dd6eb46436fa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:14.224482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:14.241050 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1c5063ca-3c31-4b8f-8793-dd6eb46436fa tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051842 Jul 26 03:15:14.241965 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 269/549] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:15:14 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:14.820053 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:14.820611 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:14.827992 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:14.828438 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:14.829207 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:14.829623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:14.964737 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:14.973689 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9cd385b2-a526-401b-87b2-e71bb803aa7f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1673 microversion: 2.1 time: 0.157871 Jul 26 03:15:14.974636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 281/550] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:14 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:15.254231 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bf8c0dd3-50bd-407e-a9db-4e48382fab3f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:15.256406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bf8c0dd3-50bd-407e-a9db-4e48382fab3f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:15.263180 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dd3-50bd-407e-a9db-4e48382fab3f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:15.263699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dd3-50bd-407e-a9db-4e48382fab3f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:15.264542 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dd3-50bd-407e-a9db-4e48382fab3f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:15.265067 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bf8c0dd3-50bd-407e-a9db-4e48382fab3f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:15.296473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bf8c0dd3-50bd-407e-a9db-4e48382fab3f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046464 Jul 26 03:15:15.297538 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 270/551] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:15:15 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:16.003698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:16.004310 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:16.031759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.043532 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.045031 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.047533 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.313787 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-694374f9-164b-4917-9a3a-60e6846f02cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:16.319967 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-694374f9-164b-4917-9a3a-60e6846f02cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:16.321718 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:16.330306 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c99bffa2-d1fd-4d13-bb2f-6aebd10df904 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1673 microversion: 2.1 time: 0.338979 Jul 26 03:15:16.331127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-694374f9-164b-4917-9a3a-60e6846f02cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.331800 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-694374f9-164b-4917-9a3a-60e6846f02cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.333637 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-694374f9-164b-4917-9a3a-60e6846f02cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.334703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-694374f9-164b-4917-9a3a-60e6846f02cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.349830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 282/552] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:15 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1673 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:16.395121 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-694374f9-164b-4917-9a3a-60e6846f02cc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088750 Jul 26 03:15:16.404020 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 271/553] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:15:16 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:15:16.490177 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:16.490927 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:16.498238 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.498925 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.499752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.500347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.533218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:15:16.646074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3f742c46-c1c8-436c-9408-1cff637a23cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 204 len: 0 microversion: 2.1 time: 0.159584 Jul 26 03:15:16.651159 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 283/554] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:15:16 2022] DELETE /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:15:16.656013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:16.656621 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:16.663299 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.663790 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.664560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:16.665160 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:16.850564 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:16.858225 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-977f28b9-cf76-4f82-a05d-1421a071142f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1680 microversion: 2.1 time: 0.206158 Jul 26 03:15:16.859124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 272/555] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:16 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:17.089271 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-87f9e8b7-5ac2-4892-a262-711cd4f0d27d req-536dbb2b-2384-423f-8ad5-da22c8b23b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c517b5ca-379c-4830-bc26-021ce1412c76", "name": "network-vif-deleted", "tag": "d86abaff-32bb-4e23-9486-8cfc0e7fcbfa"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:17.100631 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-87f9e8b7-5ac2-4892-a262-711cd4f0d27d req-536dbb2b-2384-423f-8ad5-da22c8b23b1a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:17.101063 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-87f9e8b7-5ac2-4892-a262-711cd4f0d27d req-536dbb2b-2384-423f-8ad5-da22c8b23b1a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:17.112181 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-87f9e8b7-5ac2-4892-a262-711cd4f0d27d req-536dbb2b-2384-423f-8ad5-da22c8b23b1a service nova] Creating event network-vif-deleted:d86abaff-32bb-4e23-9486-8cfc0e7fcbfa for instance c517b5ca-379c-4830-bc26-021ce1412c76 on hv-cinder-85084 Jul 26 03:15:17.117051 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-87f9e8b7-5ac2-4892-a262-711cd4f0d27d req-536dbb2b-2384-423f-8ad5-da22c8b23b1a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035169 Jul 26 03:15:17.120618 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 284/556] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:17.354270 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:17.354930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:17.362049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:17.362494 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:17.363715 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:17.363715 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:17.429777 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:17.443257 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9e680370-3804-4821-8499-ee696a9451bf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1606 microversion: 2.1 time: 0.094205 Jul 26 03:15:17.444073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 273/557] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:17 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:17.889959 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:17.891052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:17.898650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:17.899144 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:17.899909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:17.900393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:18.060094 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:18.068038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-04b3ec61-d048-481e-b483-7f60e42ca60a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1680 microversion: 2.1 time: 0.191653 Jul 26 03:15:18.068964 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 285/558] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:17 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:18.464599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:18.465204 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:18.472048 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:18.472494 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:18.473254 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:18.473682 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:18.504704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:18.505143 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:18.505611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lazy-loading 'fault' on Instance uuid c517b5ca-379c-4830-bc26-021ce1412c76 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:15:18.546255 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:18.554181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b02c78da-d377-4dce-b78b-2aa4685c6fe0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 200 len: 1328 microversion: 2.1 time: 0.093398 Jul 26 03:15:18.554586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 274/559] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:18 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:19.090357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:19.090894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:19.097843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:19.098279 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:19.099056 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:19.099529 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:19.171934 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:19.179676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2e347d7b-6a08-41fd-b3ee-15bd20703ca9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 200 len: 1613 microversion: 2.1 time: 0.093414 Jul 26 03:15:19.180234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 286/560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:19 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:19.450009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-1dbe7736-4d4a-4bcd-ac28-a1278c79ab27 req-d7299448-fed8-4084-9bb2-58224a0ee3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606", "name": "network-vif-deleted", "tag": "8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:19.459682 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-1dbe7736-4d4a-4bcd-ac28-a1278c79ab27 req-d7299448-fed8-4084-9bb2-58224a0ee3cf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:19.460753 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-1dbe7736-4d4a-4bcd-ac28-a1278c79ab27 req-d7299448-fed8-4084-9bb2-58224a0ee3cf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:19.477618 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-1dbe7736-4d4a-4bcd-ac28-a1278c79ab27 req-d7299448-fed8-4084-9bb2-58224a0ee3cf service nova] Creating event network-vif-deleted:8ba1b2cf-5bea-4bef-9b3c-9831bafa71b6 for instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 on hv-cinder-85084 Jul 26 03:15:19.484415 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-1dbe7736-4d4a-4bcd-ac28-a1278c79ab27 req-d7299448-fed8-4084-9bb2-58224a0ee3cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038210 Jul 26 03:15:19.485770 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 275/561] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:19.522819 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3de9e9c2-c61b-455d-a64b-528a05bd04e9 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f79615430>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:19.576821 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3de9e9c2-c61b-455d-a64b-528a05bd04e9 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/143be27c-edcf-44be-9997-120347c58e6e" status: 200 len: 351 microversion: 2.1 time: 0.057810 Jul 26 03:15:19.577387 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 287/562] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:15:19 2022] GET /compute/v2.1/os-volumes/143be27c-edcf-44be-9997-120347c58e6e => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:19.584769 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:19.584769 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:19.587184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:19.587507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:19.588277 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:19.588816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:19.613455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] HTTP exception thrown: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Request method failure captured: Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 HTTP/1.1 Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tAgcw6gS7lcI8gr-yglFGxrTrdWtHqSwzB_f-f8cb4Fx0L63n86hDG_geJq7c2LtkoB26xWpX1OxjpLk6po729CVrz25-qMmKz0Yhs8Y45ZqQu1yfvLroruutlcbuz4L3k0mmzeMHgjp2LFmIe3kSWtpDzLakqXOMvmuqnsCcaxsE Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:15:19.615329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: fbdac72f58df4335b3790c5fb1609f5b Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:15:19.617041 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'c517b5ca-379c-4830-bc26-021ce1412c76'} Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:15:19.617976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:15:19.619481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:19.621450 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Returning 404 to user: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:15:19.622509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6c59d139-1af8-4f66-8ccd-8c3166616f8d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 404 len: 111 microversion: 2.1 time: 0.051031 Jul 26 03:15:19.627176 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 276/563] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:19 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:15:19.633788 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5702204b-49f4-440b-8569-c1b023670884 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '.version_select at 0x7f5f799ee820>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:19.674979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5702204b-49f4-440b-8569-c1b023670884 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961507355" status: 202 len: 0 microversion: 2.1 time: 0.046716 Jul 26 03:15:19.675651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 288/564] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Jul 26 03:15:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961507355 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 03:15:20.201656 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:20.202817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:20.212773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:20.213300 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:20.214764 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:20.215320 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:20.230866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 HTTP/1.1 Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:15:20.232608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:15:20.234211 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606'} Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:15:20.235323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:15:20.236591 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:15:20.237786 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:15:20.238754 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4250d0a8-5ca5-4a70-bae4-f8dabb0440df tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 404 len: 111 microversion: 2.1 time: 0.040079 Jul 26 03:15:20.239597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 277/565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:20 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:15:20.248859 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a59966c2-2956-47e9-be58-c2e34c8fb40b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '.version_select at 0x7f5f79585dc0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:20.273356 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a59966c2-2956-47e9-be58-c2e34c8fb40b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318805699" status: 202 len: 0 microversion: 2.1 time: 0.028789 Jul 26 03:15:20.274209 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 289/566] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Jul 26 03:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318805699 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 03:15:20.662848 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6fc4a977-649b-482a-9ebc-982f5a75481f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'create', calling method: .version_select at 0x7f5f796d4430>, body: {"keypair": {"name": "tempest-keypair-126944270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsXq5UqgPtKWxmFp3ELhB/vsMwBjheOooFtP2X7x5bYnSjVlk0dSAUl07Yt0Md7329lvUDaS3V9GHp380R+cIVjbIEw1JVfg6l2CE+Z+lOtNZxH2asgURiAxuNCZE4f6g=="}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:20.680860 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-6fc4a977-649b-482a-9ebc-982f5a75481f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:15:20.684986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-6fc4a977-649b-482a-9ebc-982f5a75481f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for user fbdac72f58df4335b3790c5fb1609f5b and project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:15:20.709593 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6fc4a977-649b-482a-9ebc-982f5a75481f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050574 Jul 26 03:15:20.710206 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 278/567] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:15:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:20.961468 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d2e15f2d-d304-44fb-9809-bd3b6494915e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: .version_select at 0x7f5f796051f0>, body: {"keypair": {"name": "tempest-keypair-1778458967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqK0K973/AXFwl8HnlxsI4XdRkQvqGZeOUut8c9USPzWnxzgSQpVM+ErGn+ppajdo/Op0DgUWpLlIPwEFFLKM9SZ8lIHx5u656btuuaTqT+9tEml6hfYa2Y9WXiSefNww=="}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:20.976692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d2e15f2d-d304-44fb-9809-bd3b6494915e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:15:20.980828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-d2e15f2d-d304-44fb-9809-bd3b6494915e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'key_pairs'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:15:21.017653 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d2e15f2d-d304-44fb-9809-bd3b6494915e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060188 Jul 26 03:15:21.018776 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 290/568] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:15:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:21.046063 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-671d5565-9d48-4ea1-8788-6767f6ff91c8 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f794e3dc0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:21.096800 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-671d5565-9d48-4ea1-8788-6767f6ff91c8 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0997e962-a5cd-4bb6-8ac3-ef93cdfeb1b1" status: 200 len: 350 microversion: 2.1 time: 0.054611 Jul 26 03:15:21.105184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 279/569] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:15:21 2022] GET /compute/v2.1/os-volumes/0997e962-a5cd-4bb6-8ac3-ef93cdfeb1b1 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:22.194361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1875617001", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ee3d40a-6386-40e4-904c-54dd185c894f"}], "security_groups": [{"name": "tempest-securitygroup--762631603"}], "key_name": "tempest-keypair-126944270", "user_data": "}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:22.202716 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:22.300294 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] validate_networks() for [('2ee3d40a-6386-40e4-904c-54dd185c894f', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:15:22.540834 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-999f555d-17b4-4b86-8cbe-fd71ab02410b tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f794f8940>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:22.588842 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-999f555d-17b4-4b86-8cbe-fd71ab02410b tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9704c417-d897-40a9-80bb-c21356926398" status: 200 len: 350 microversion: 2.1 time: 0.054221 Jul 26 03:15:22.589484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 280/570] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:15:22 2022] GET /compute/v2.1/os-volumes/9704c417-d897-40a9-80bb-c21356926398 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:15:22.594564 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1888914187", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f744be8-1146-4ad7-825e-8d297f751ced"}], "security_groups": [{"name": "tempest-securitygroup--729245576"}], "key_name": "tempest-keypair-1778458967", "user_data": "}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:22.603199 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:22.679320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:15:22.679747 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:15:22.680225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:15:22.680619 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:15:22.681016 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:15:22.690506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:22.690941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:22.691798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:22.692220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:22.701015 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] validate_networks() for [('3f744be8-1146-4ad7-825e-8d297f751ced', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:15:22.709205 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:15:22.713097 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Getting quotas for user fbdac72f58df4335b3790c5fb1609f5b and project 6daba0980548418ea98d4d0cf42ef92f. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:15:22.723901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:15:22.726294 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:15:22.783042 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-026221b1-d4a4-4fa8-8e12-f2266892555e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593460 Jul 26 03:15:22.783875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 291/571] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:15:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:15:22.790351 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3e681b95-fccf-4f88-81f4-0ef5d76bf3e2 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f7952e670>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:22.879681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3e681b95-fccf-4f88-81f4-0ef5d76bf3e2 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094658 Jul 26 03:15:22.880264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 292/572] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Jul 26 03:15:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:22.884808 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bf66b85c-fbf1-4383-b057-33f7971bd9fb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:22.885837 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bf66b85c-fbf1-4383-b057-33f7971bd9fb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:22.942093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bf66b85c-fbf1-4383-b057-33f7971bd9fb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:22.949804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bf66b85c-fbf1-4383-b057-33f7971bd9fb tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1237 microversion: 2.1 time: 0.068532 Jul 26 03:15:22.951046 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 293/573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:22 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:22.956795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1f8baaaf-a350-4b83-a610-6de8de17ea33 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f79682c10>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.044793 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1f8baaaf-a350-4b83-a610-6de8de17ea33 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091691 Jul 26 03:15:23.046128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 294/574] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Jul 26 03:15:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:23.062141 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-78e7785e-141e-4efb-86b5-c6c62436949a tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f7c10c8b0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.117368 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:15:23.117368 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:15:23.117368 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:15:23.117368 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:15:23.117783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:15:23.126511 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:23.127209 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:23.128255 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:23.128834 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:23.148006 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:15:23.153238 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Getting quotas for user 9d3fd2b3c6cd47019e15fbf959d47381 and project 9d8d482c37d849cf8bdf035e110e0f34. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:15:23.153488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-78e7785e-141e-4efb-86b5-c6c62436949a tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095387 Jul 26 03:15:23.154269 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 295/575] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:23.167172 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:15:23.167751 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fb081388-edec-43d6-91ac-7851fce5a200 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f795dc4c0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.170071 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:15:23.219798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0cf315dd-4551-463c-89a4-6e08deb410b6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.628886 Jul 26 03:15:23.220455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 281/576] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:15:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:15:23.232763 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-98de7379-fe78-4ecc-bbb2-4ab82909531a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.233630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-98de7379-fe78-4ecc-bbb2-4ab82909531a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:23.263853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fb081388-edec-43d6-91ac-7851fce5a200 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099722 Jul 26 03:15:23.272212 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 296/577] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:23.278874 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c41dae9c-4736-4000-938c-6d9425af6eb4 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f79682e50>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.326523 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-98de7379-fe78-4ecc-bbb2-4ab82909531a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:23.335536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-98de7379-fe78-4ecc-bbb2-4ab82909531a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1242 microversion: 2.1 time: 0.106324 Jul 26 03:15:23.339148 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 282/578] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:23.385466 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c41dae9c-4736-4000-938c-6d9425af6eb4 tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.110871 Jul 26 03:15:23.386319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 297/579] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:23.399325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f8da5ca4-1618-4828-b697-30189700b69e tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f796898b0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.503126 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f8da5ca4-1618-4828-b697-30189700b69e tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.107569 Jul 26 03:15:23.503694 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 283/580] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:23.517224 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1cdd330e-5738-4cd7-9d2d-8a7fbfcbe40f tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f7952eca0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.605438 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1cdd330e-5738-4cd7-9d2d-8a7fbfcbe40f tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092100 Jul 26 03:15:23.606214 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 298/581] 10.222.0.42 () {58 vars in 1188 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:15:23.619809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3b85c592-d361-49ae-a77b-cbcdd41780db tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] Calling method '.version_select at 0x7f5f794e3160>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.703514 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3b85c592-d361-49ae-a77b-cbcdd41780db tempest-VolumesTestJSON-1043712650 tempest-VolumesTestJSON-1043712650-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087890 Jul 26 03:15:23.704079 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 284/582] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:23.972817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:23.974035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:23.983244 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:23.984888 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:23.986257 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:23.987105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:24.068011 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:24.075918 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6319f9f4-1a8c-4ec7-9648-64178c9f1d2a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1295 microversion: 2.1 time: 0.108722 Jul 26 03:15:24.076471 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 299/583] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:23 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:24.360409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:24.361015 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:24.368160 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:24.368611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:24.369380 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:24.369814 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:24.467744 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:24.478229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-00d2c894-1a7b-4a1e-a4e1-4085d7797a29 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1302 microversion: 2.1 time: 0.121155 Jul 26 03:15:24.490978 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 285/584] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:24 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1302 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:24.572194 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4d4dfb6b-a42f-4740-83bc-4583a2327cc4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:24.572805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4d4dfb6b-a42f-4740-83bc-4583a2327cc4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:24.579767 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d4dfb6b-a42f-4740-83bc-4583a2327cc4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:24.580444 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d4dfb6b-a42f-4740-83bc-4583a2327cc4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:24.581404 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d4dfb6b-a42f-4740-83bc-4583a2327cc4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:24.582074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d4dfb6b-a42f-4740-83bc-4583a2327cc4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:24.608448 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4d4dfb6b-a42f-4740-83bc-4583a2327cc4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/ips" status: 200 len: 152 microversion: 2.20 time: 0.040367 Jul 26 03:15:24.609083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 300/585] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Jul 26 03:15:24 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:15:25.097841 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:25.098737 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:25.107304 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:25.108034 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:25.109625 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:25.110135 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:25.287491 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:25.296731 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7d243693-3cc2-40ae-86da-d2d0130d2b6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1362 microversion: 2.1 time: 0.203785 Jul 26 03:15:25.297536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 286/586] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:25 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:25.502820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:25.503746 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:25.510499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:25.510967 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:25.511795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:25.512229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:25.743251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:25.752233 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-691c9639-2e89-4967-a984-31edd4c510ff tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.253761 Jul 26 03:15:25.753045 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 301/587] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:25 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:25.787274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-31193048-eeb3-40f7-8a3e-9eab8bf4acf9 req-8948364d-b806-4d3d-b430-8178475e6f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3492df7b-e7b3-45fe-a70b-df0e94233036", "tag": "f962a46d-878a-459e-9839-e85be7e331cc"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:25.798833 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-31193048-eeb3-40f7-8a3e-9eab8bf4acf9 req-8948364d-b806-4d3d-b430-8178475e6f2e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:25.799596 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-31193048-eeb3-40f7-8a3e-9eab8bf4acf9 req-8948364d-b806-4d3d-b430-8178475e6f2e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:25.817661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-31193048-eeb3-40f7-8a3e-9eab8bf4acf9 req-8948364d-b806-4d3d-b430-8178475e6f2e service nova] Creating event network-changed:f962a46d-878a-459e-9839-e85be7e331cc for instance 3492df7b-e7b3-45fe-a70b-df0e94233036 on hv-cinder-85084 Jul 26 03:15:25.831119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-31193048-eeb3-40f7-8a3e-9eab8bf4acf9 req-8948364d-b806-4d3d-b430-8178475e6f2e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047697 Jul 26 03:15:25.832085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 287/588] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:26.233600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-576b1c90-abc4-4e1c-9c51-7bfd71682699 req-b45373c7-c123-4d51-8b01-f48521d1edc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674e6a56-e2e2-4ad6-98ac-f931a03e5dec", "tag": "31d7b859-ab14-4275-adc3-9ff278f6873a"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:26.254924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-576b1c90-abc4-4e1c-9c51-7bfd71682699 req-b45373c7-c123-4d51-8b01-f48521d1edc5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.257488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-576b1c90-abc4-4e1c-9c51-7bfd71682699 req-b45373c7-c123-4d51-8b01-f48521d1edc5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.281312 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-576b1c90-abc4-4e1c-9c51-7bfd71682699 req-b45373c7-c123-4d51-8b01-f48521d1edc5 service nova] Creating event network-changed:31d7b859-ab14-4275-adc3-9ff278f6873a for instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec on hv-cinder-85084 Jul 26 03:15:26.286463 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-576b1c90-abc4-4e1c-9c51-7bfd71682699 req-b45373c7-c123-4d51-8b01-f48521d1edc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056558 Jul 26 03:15:26.287818 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 302/589] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:26.319522 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:26.320635 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:26.328221 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.329286 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.329628 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.330205 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.494359 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:26.502039 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7724c430-ed6e-4dde-afe3-a28b704a95a1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1362 microversion: 2.1 time: 0.187844 Jul 26 03:15:26.502528 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 288/590] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:26 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:26.529575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:26.530264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:26.536634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.537086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.537836 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.538263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.541998 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:26.562558 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lazy-loading 'flavor' on Instance uuid dbe0d48e-9b52-48e2-bf40-30f16f2fd37d {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:15:26.742807 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-86d3309d-11b6-40da-b777-909e91abdc26 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/action" status: 202 len: 0 microversion: 2.20 time: 0.217531 Jul 26 03:15:26.743462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 303/591] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Jul 26 03:15:26 2022] POST /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 03:15:26.751906 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:26.752507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:26.758981 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.759435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.760198 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.760632 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.774117 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:26.774861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:26.781226 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.781701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.782460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:26.782887 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:26.892644 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:26.900590 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:26.902064 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:26.903224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-af64db69-cb4c-4239-92dd-453840280f17 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.155350 Jul 26 03:15:26.903815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 289/592] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:26 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:26.915550 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:26.923100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b195cb16-dc41-4b78-a63b-35a62ead39e0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.153309 Jul 26 03:15:26.923668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 304/593] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:26 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:27.523480 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:27.524088 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:27.538344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:27.538833 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:27.539668 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:27.542934 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:27.717249 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:27.726040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d06dc8d6-2365-4967-8006-1c5e82e29442 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1362 microversion: 2.1 time: 0.206812 Jul 26 03:15:27.726633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 290/594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:27 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:27.926160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:27.926756 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:27.933451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:27.933909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:27.934691 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:27.935235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:27.946834 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:27.947471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:27.954650 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:27.955156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:27.955879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:27.956304 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:28.086241 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:28.094971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:28.096819 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:28.098279 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4b535bee-c790-470f-b146-64412f3e78f8 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.176501 Jul 26 03:15:28.099039 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 305/595] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:27 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:28.114298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:28.122417 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-61697796-b410-4f8d-9d26-dbd195035a6e tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.182278 Jul 26 03:15:28.123012 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 291/596] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:27 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:28.748093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:28.748866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:28.755219 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:28.755667 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:28.756427 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:28.757027 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:28.889896 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:28.897988 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c55b8b43-d304-4560-809a-b4f6c2810ff3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1362 microversion: 2.1 time: 0.153690 Jul 26 03:15:28.898752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 306/597] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:28 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:29.121213 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:29.121769 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:29.128293 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:29.128734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:29.129572 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:29.129891 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:29.143266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:29.144106 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:29.150843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:29.151382 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:29.152574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:29.153051 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:29.286914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:29.296322 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:29.298055 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:29.300161 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0dc0c07a-ca57-4fba-91f3-b0d2451f8cb7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.182934 Jul 26 03:15:29.300897 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 292/598] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:29 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:29.303470 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:29.311052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e958e608-aaa4-4bce-9f78-dad56b361181 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.171724 Jul 26 03:15:29.311703 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 307/599] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:29 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:29.793537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-69eb93e8-32ef-4be3-a72d-0c917a7cd666 req-9d9dee14-befd-49d9-bc4e-d8d9583b54c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3492df7b-e7b3-45fe-a70b-df0e94233036", "name": "network-vif-plugged", "status": "completed", "tag": "f962a46d-878a-459e-9839-e85be7e331cc"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:29.803658 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-69eb93e8-32ef-4be3-a72d-0c917a7cd666 req-9d9dee14-befd-49d9-bc4e-d8d9583b54c5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:29.804119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-69eb93e8-32ef-4be3-a72d-0c917a7cd666 req-9d9dee14-befd-49d9-bc4e-d8d9583b54c5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:29.816873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-69eb93e8-32ef-4be3-a72d-0c917a7cd666 req-9d9dee14-befd-49d9-bc4e-d8d9583b54c5 service nova] Creating event network-vif-plugged:f962a46d-878a-459e-9839-e85be7e331cc for instance 3492df7b-e7b3-45fe-a70b-df0e94233036 on hv-cinder-85084 Jul 26 03:15:29.821673 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-69eb93e8-32ef-4be3-a72d-0c917a7cd666 req-9d9dee14-befd-49d9-bc4e-d8d9583b54c5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031876 Jul 26 03:15:29.822275 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 293/600] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:29.919357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:29.919981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:29.926095 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:29.926538 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:29.927352 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:29.927779 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:30.063705 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:30.071265 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-91461c93-85f2-4815-aa44-05fd69da4654 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1362 microversion: 2.1 time: 0.155698 Jul 26 03:15:30.071838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 308/601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:29 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:30.329616 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:30.330580 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:30.335445 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:30.336044 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:30.338598 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:30.339086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:30.339861 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:30.340291 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:30.342980 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:30.343439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:30.344217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:30.344641 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:30.468697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:30.474919 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:30.477497 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:30.479020 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:30.480193 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3ae14851-c0e5-4711-a888-bf7078060cc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.159018 Jul 26 03:15:30.480784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 294/602] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:30 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:30.482686 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bbd55c51-bf00-49e6-a566-9a1c617bfeb0 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.153024 Jul 26 03:15:30.483302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 309/603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:30 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:31.092471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:31.093083 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:31.099960 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:31.099960 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:31.100599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:31.100994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:31.503699 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:31.504408 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:31.511262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:31.511711 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:31.512471 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:31.512899 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:31.524762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:31.529783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=100 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:31.535759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-dc6d317e-6231-47e8-b087-0e1d812d273b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1362 microversion: 2.1 time: 0.447070 Jul 26 03:15:31.536453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 295/604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:31 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:31.541354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:31.542171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:31.548976 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:31.549750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:31.550741 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:31.551286 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:31.650163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:31.658896 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:31.660414 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:31.661668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9d1521f4-06c6-4255-8b3d-8e32cc3d05a7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.162856 Jul 26 03:15:31.662715 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 310/605] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:31 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:31.697954 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:31.706877 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e8be7695-d56e-4694-8d7b-f43bf5a9dd02 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.169141 Jul 26 03:15:31.707475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 296/606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:31 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:31.849015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-098bdc5c-40b0-400e-aa29-206073a59980 req-4716966b-3ce8-4edc-bbce-68781d1c4ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674e6a56-e2e2-4ad6-98ac-f931a03e5dec", "name": "network-vif-plugged", "status": "completed", "tag": "31d7b859-ab14-4275-adc3-9ff278f6873a"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:31.862083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-098bdc5c-40b0-400e-aa29-206073a59980 req-4716966b-3ce8-4edc-bbce-68781d1c4ad8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:31.862669 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-098bdc5c-40b0-400e-aa29-206073a59980 req-4716966b-3ce8-4edc-bbce-68781d1c4ad8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:31.874536 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-098bdc5c-40b0-400e-aa29-206073a59980 req-4716966b-3ce8-4edc-bbce-68781d1c4ad8 service nova] Creating event network-vif-plugged:31d7b859-ab14-4275-adc3-9ff278f6873a for instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec on hv-cinder-85084 Jul 26 03:15:31.879594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-098bdc5c-40b0-400e-aa29-206073a59980 req-4716966b-3ce8-4edc-bbce-68781d1c4ad8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035548 Jul 26 03:15:31.880167 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 311/607] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:32.560737 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:32.561699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:32.573170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.574293 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.575595 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.576356 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.685960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:32.686657 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:32.693093 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.693542 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.694307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.694738 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.699629 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:32.711326 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:32.718780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-2cacadd4-cbdb-4f6c-a8a9-c72c2fe5be90 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1548 microversion: 2.1 time: 0.164553 Jul 26 03:15:32.719378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 297/608] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:32 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:32.727143 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:32.727960 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:32.734186 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.734870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.735618 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.736239 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.826052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:32.834384 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:32.835907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:32.837070 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-072cdc43-862a-4963-a637-886d353c963c tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.156003 Jul 26 03:15:32.837803 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 312/609] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:32 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:32.842466 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-25c93ba2-0667-4e93-b174-85f5457707f3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:32.843148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-25c93ba2-0667-4e93-b174-85f5457707f3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:32.850166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c93ba2-0667-4e93-b174-85f5457707f3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.850617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c93ba2-0667-4e93-b174-85f5457707f3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.851400 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c93ba2-0667-4e93-b174-85f5457707f3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:32.851996 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-25c93ba2-0667-4e93-b174-85f5457707f3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:32.869342 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:32.876866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5b2c2475-c356-40af-b9e0-5c8ebf1ccd77 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.153464 Jul 26 03:15:32.877422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 298/610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:32 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:32.927055 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-25c93ba2-0667-4e93-b174-85f5457707f3 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087943 Jul 26 03:15:32.927743 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 313/611] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:15:32 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:33.860905 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:33.861459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:33.863471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:33.864308 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=12 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:33.871940 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:33.872372 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:33.873199 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:33.873825 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:33.892615 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=12 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:33.897284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-197b8614-9200-4c7e-82de-8537c69a61b8 req-64425ce8-92fa-4784-a1d1-0b971c971cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3492df7b-e7b3-45fe-a70b-df0e94233036", "tag": "f962a46d-878a-459e-9839-e85be7e331cc"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:33.906871 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-197b8614-9200-4c7e-82de-8537c69a61b8 req-64425ce8-92fa-4784-a1d1-0b971c971cae service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:33.907343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-197b8614-9200-4c7e-82de-8537c69a61b8 req-64425ce8-92fa-4784-a1d1-0b971c971cae service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:33.920331 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-197b8614-9200-4c7e-82de-8537c69a61b8 req-64425ce8-92fa-4784-a1d1-0b971c971cae service nova] Creating event network-changed:f962a46d-878a-459e-9839-e85be7e331cc for instance 3492df7b-e7b3-45fe-a70b-df0e94233036 on hv-cinder-85084 Jul 26 03:15:33.925555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-197b8614-9200-4c7e-82de-8537c69a61b8 req-64425ce8-92fa-4784-a1d1-0b971c971cae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033853 Jul 26 03:15:33.926160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 314/612] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:15:33.931417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:33.932099 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:33.938299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:33.938755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:33.939530 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:33.939958 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:34.026894 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:34.036502 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:34.038014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:34.039214 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-05466044-1fca-4c32-bec8-8ecb521f2ed5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.182309 Jul 26 03:15:34.039781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 299/613] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:33 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:34.085249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:34.092737 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-85b9f78d-456a-458a-9b40-c69439d74a78 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.165292 Jul 26 03:15:34.093303 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 315/614] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:33 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:35.066090 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:35.067103 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:35.078641 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:35.079441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:35.080699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:35.081415 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:35.113792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:35.114402 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:35.121651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:35.121994 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:35.122763 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:35.123242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:35.414870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:35.416497 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:35.423248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:35.424145 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-47760fde-534f-439f-aa5d-0eb9b1c116f4 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1367 microversion: 2.1 time: 0.314269 Jul 26 03:15:35.424796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:35.425236 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 316/615] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:35 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:35.438540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a5d06c2c-6b6f-4f18-bd45-85b29cb95e72 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.379155 Jul 26 03:15:35.439371 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 300/616] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:35 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:36.445103 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:36.445708 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:36.455197 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:36.455663 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:36.456434 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:36.457064 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:36.462749 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:36.463319 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:36.470138 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:36.470600 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:36.471399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:36.471821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:36.593179 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:36.601195 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2765068d-e779-4c57-9607-30cf72da4ab6 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1557 microversion: 2.1 time: 0.160039 Jul 26 03:15:36.601870 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 317/617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:36 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:36.608394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:36.616702 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:36.618271 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:36.619560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-48293109-b33e-4e39-af96-de73965bd861 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.161650 Jul 26 03:15:36.620188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 301/618] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:36 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:36.621606 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-16d9a091-4f69-4448-a470-cb7e28ce589f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:36.622105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-16d9a091-4f69-4448-a470-cb7e28ce589f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:36.628245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d9a091-4f69-4448-a470-cb7e28ce589f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:36.628684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d9a091-4f69-4448-a470-cb7e28ce589f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:36.629434 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d9a091-4f69-4448-a470-cb7e28ce589f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:36.629857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d9a091-4f69-4448-a470-cb7e28ce589f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:36.706346 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-16d9a091-4f69-4448-a470-cb7e28ce589f tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088501 Jul 26 03:15:36.706986 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 318/619] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Jul 26 03:15:36 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:15:37.643319 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:37.643874 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:37.651844 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:37.652669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:37.653734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:37.654170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:37.784622 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:37.793001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:37.794496 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:37.795690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-64b8f297-4b5b-472e-a6bb-4c70209a9bb4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.156856 Jul 26 03:15:37.796247 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 302/620] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:37 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:37.936684 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-e19de7c7-2517-4089-88a7-a5bad67e22ad req-38b767d4-77c0-413a-ad90-2dd759732ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "674e6a56-e2e2-4ad6-98ac-f931a03e5dec", "tag": "31d7b859-ab14-4275-adc3-9ff278f6873a"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:37.946794 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e19de7c7-2517-4089-88a7-a5bad67e22ad req-38b767d4-77c0-413a-ad90-2dd759732ded service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:37.947259 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e19de7c7-2517-4089-88a7-a5bad67e22ad req-38b767d4-77c0-413a-ad90-2dd759732ded service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:37.958817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-e19de7c7-2517-4089-88a7-a5bad67e22ad req-38b767d4-77c0-413a-ad90-2dd759732ded service nova] Creating event network-changed:31d7b859-ab14-4275-adc3-9ff278f6873a for instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec on hv-cinder-85084 Jul 26 03:15:37.963793 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-e19de7c7-2517-4089-88a7-a5bad67e22ad req-38b767d4-77c0-413a-ad90-2dd759732ded service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031313 Jul 26 03:15:37.964387 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 319/621] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:15:38.819411 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:38.820560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:38.827380 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:38.827821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:38.828598 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:38.829020 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:38.977095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:38.987030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:38.988686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:38.989912 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1127665e-fe90-45cd-8ee0-1cf466aa0e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.175668 Jul 26 03:15:38.990456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 303/622] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:38 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:40.019658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:40.020371 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:40.026768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:40.027230 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:40.027977 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:40.028399 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:40.046131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:40.166586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:40.174712 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:40.176309 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:40.177462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-509fb963-27fc-47a9-a6b3-f39278cb630f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.162633 Jul 26 03:15:40.178027 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 320/623] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:40 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:41.200936 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:41.201568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:41.207910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:41.208349 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:41.209101 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:41.209527 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:41.347620 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:41.355585 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:41.357457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:41.358377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-67ded603-66a6-4822-b894-6793a9eed9ad tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.161886 Jul 26 03:15:41.358961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 304/624] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:41 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:42.385696 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:42.386651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:42.397162 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:42.397927 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:42.399181 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:42.399607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:42.531691 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:42.542288 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:42.543793 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:42.544946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0fd82ccd-a31d-4b6d-858a-34b40cbe7c53 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.166183 Jul 26 03:15:42.545495 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 321/625] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:42 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:42.620151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:42.620656 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:42.628107 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:42.628565 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:42.629317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:42.629768 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:42.652203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lazy-loading 'flavor' on Instance uuid 1c126b57-79ad-4bd0-9f2a-db16536258e3 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:15:42.728094 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5c32a081-fa65-4359-a199-3966fb11420c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "POST /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3/action" status: 202 len: 0 microversion: 2.1 time: 0.111840 Jul 26 03:15:42.729219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 305/626] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:15:42 2022] POST /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:15:42.737380 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:42.738327 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:42.744820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:42.745231 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:42.746270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:42.746844 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:42.894232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:42.902374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0313c54c-7b5d-45ea-9eb2-cf7ca17980dd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.168804 Jul 26 03:15:42.903128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 322/627] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:42 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:43.573381 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:43.574114 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:43.582366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:43.582916 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:43.583942 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:43.584475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:43.741210 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:43.749424 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:43.750927 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:43.752214 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-386e17a1-4765-431c-81df-575101f2bd96 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1744 microversion: 2.20 time: 0.186082 Jul 26 03:15:43.752801 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 306/628] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:43 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:43.926420 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:43.927306 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:43.935555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:43.936001 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:43.936768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:43.937192 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:44.072262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:44.080448 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fa765545-aa0a-4bbd-a511-339dcc610676 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.159189 Jul 26 03:15:44.081030 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 323/629] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:43 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:44.775611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:44.776202 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:44.782876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:44.783560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:44.784314 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:44.784736 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:44.918401 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:44.926550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:44.928112 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:44.929254 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3e88fd12-4b98-48b0-880c-b71a4346b944 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.157583 Jul 26 03:15:44.929819 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 307/630] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:44 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:45.106156 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:45.107237 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:45.118076 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:45.119009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:45.120256 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:45.120999 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:45.265084 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:45.273687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-eb27b608-4d29-4dc7-8ca9-93eb93d30af2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.174103 Jul 26 03:15:45.274189 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 324/631] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:45 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:45.953383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:45.954054 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:45.960909 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:45.961374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:45.962123 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:45.962554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:46.094987 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:46.107324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:46.109676 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:46.111707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-433d79e6-f5ef-4ea5-a804-084ee8295013 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.161857 Jul 26 03:15:46.112513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 308/632] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:45 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:46.298921 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:46.300040 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:46.311102 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:46.311830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:46.313137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:46.313848 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:46.457266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:46.468180 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-dd3976b4-8ad5-4734-802a-7a2028bf44d1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.175766 Jul 26 03:15:46.469014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 325/633] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:46 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:47.307330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:47.307741 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:47.314266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:47.314781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:47.315666 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:47.316171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:47.451156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:47.459537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:47.461218 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:47.462377 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-555d4612-6e03-437b-a4c6-353d97b09e24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.330475 Jul 26 03:15:47.462936 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 309/634] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:47 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:47.493830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:47.495239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:47.502891 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:47.503959 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:47.504886 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:47.505542 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:47.644327 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:47.652032 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-29657229-ea05-416b-a005-f9c142d6ced5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.162174 Jul 26 03:15:47.652721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 326/635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:47 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:48.485166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:48.486439 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:48.495825 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:48.496394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:48.497184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:48.497829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:48.521321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:48.674524 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:48.675908 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:48.679493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:48.691018 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:48.691732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:48.694466 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:48.694902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:48.700796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:48.702315 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:48.703725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c27df9c1-dd0b-40bc-8bf2-3a3399325505 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.222763 Jul 26 03:15:48.705372 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 310/636] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:48 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:48.845660 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:48.853962 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1d0661fe-407f-49ec-9699-4477e34e1582 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.183263 Jul 26 03:15:48.854699 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 327/637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:48 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:49.629577 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-b1d2d098-fe56-45ac-bbee-164fe6279aa9 req-4cf9bda3-9e6b-4c2c-97b8-813a69ceacc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0d48e-9b52-48e2-bf40-30f16f2fd37d", "name": "network-vif-plugged", "status": "completed", "tag": "9bba44c6-edd4-430c-95db-d19a412c48e7"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:15:49.645488 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-b1d2d098-fe56-45ac-bbee-164fe6279aa9 req-4cf9bda3-9e6b-4c2c-97b8-813a69ceacc1 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:49.646333 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-b1d2d098-fe56-45ac-bbee-164fe6279aa9 req-4cf9bda3-9e6b-4c2c-97b8-813a69ceacc1 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:49.663936 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-b1d2d098-fe56-45ac-bbee-164fe6279aa9 req-4cf9bda3-9e6b-4c2c-97b8-813a69ceacc1 service nova] Creating event network-vif-plugged:9bba44c6-edd4-430c-95db-d19a412c48e7 for instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d on hv-cinder-85084 Jul 26 03:15:49.679660 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-b1d2d098-fe56-45ac-bbee-164fe6279aa9 req-4cf9bda3-9e6b-4c2c-97b8-813a69ceacc1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054137 Jul 26 03:15:49.681232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 311/638] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:15:49.734242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:49.735066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:49.756336 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:49.756789 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:49.757566 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:49.757989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:49.878435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:49.879184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:49.888001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:49.888438 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:49.889206 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:49.889645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:49.945272 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:49.957262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:49.974007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:49.975710 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7388fb6a-6fd5-4f62-8ecd-e624015e3240 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.247921 Jul 26 03:15:49.981234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 328/639] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:49 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:50.101432 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:50.110197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a001a700-baae-4ccc-84dc-150739ed5b68 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.236274 Jul 26 03:15:50.110821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 312/640] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:49 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:51.012126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:51.013428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:51.023006 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:51.024169 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:51.025474 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:51.026111 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:51.131540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:51.132874 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:51.141124 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:51.143273 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:51.145482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:51.146829 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:51.193642 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:51.206906 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:51.208598 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:51.209755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-efcdbd8a-8955-43a5-bd3b-ebaec042a63f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.201678 Jul 26 03:15:51.211605 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 329/641] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:51 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:51.302085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:51.321178 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-223f7423-2ac8-4dfd-bbfe-f774fb39a2e2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.182899 Jul 26 03:15:51.322397 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 313/642] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:51 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:52.236857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:52.237594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:52.240335 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:52.247573 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:52.248257 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:52.249572 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:52.250102 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:52.345276 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:52.346614 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:52.357868 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:52.358881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:52.359910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:52.360589 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:52.490085 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:52.501801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:52.503328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:52.504502 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f8ff2811-b735-4beb-9eb8-5a26cf67d1d4 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.271728 Jul 26 03:15:52.515287 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 330/643] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:52 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:52.605874 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:52.614484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-70061207-9b78-4eee-8c92-08bc601070d3 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.273479 Jul 26 03:15:52.615827 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 314/644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:52 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:53.529702 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:53.530305 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:53.542834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:53.543309 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:53.544155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:53.544623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:53.640312 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:53.641440 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:53.644575 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:15:53.674421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:53.674873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:53.676554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:53.676996 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:53.706032 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:53.715138 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:53.718126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:53.719648 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fe001f36-e35a-4c37-beb3-e1c5724e3c24 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.193815 Jul 26 03:15:53.720279 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 331/645] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:53 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:53.863475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:53.872699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-930778be-2cae-4063-94b1-b609042bba5a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.240256 Jul 26 03:15:53.873709 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 315/646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:53 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:54.743115 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:54.743935 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:54.750525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:54.751274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:54.752251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:54.752676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:54.895550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:54.896916 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:54.905265 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:54.905877 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:54.906783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:54.907629 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:54.913848 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:54.925123 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:54.926620 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:54.927816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-20645a64-d4e5-4873-817d-7f51bd3df0b5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.188916 Jul 26 03:15:54.928374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 332/647] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:54 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 03:15:55.083716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:55.095038 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1c900994-20c0-431d-ab48-ebe29512f86c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.203829 Jul 26 03:15:55.096359 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 316/648] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:54 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:55.951671 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:55.952268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:55.959617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:55.960040 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:55.960827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:55.961263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:56.117079 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:56.117841 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:56.124755 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:56.125352 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:56.126476 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:56.127108 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:56.166588 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:56.182294 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:56.192260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:56.193609 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-406d41fa-13e5-493d-a687-19c1054149c2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.246490 Jul 26 03:15:56.204550 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 333/649] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:55 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:56.302397 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:56.311121 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-aa81c114-93f5-4035-a24c-6ea31775fd97 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.197919 Jul 26 03:15:56.311704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 317/650] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:56 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:15:57.222837 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:57.223628 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:57.235390 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:57.235835 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:57.236752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:57.237182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:57.332661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:57.333266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:57.340057 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:57.340495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:57.341278 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:57.341698 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:57.384113 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:57.392294 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:57.393787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:57.394928 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-544546eb-b645-458a-9296-b56cde9eba1d tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1739 microversion: 2.20 time: 0.176541 Jul 26 03:15:57.395479 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 334/651] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:57 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:57.564370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:57.576594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c4f5ba6e-aaa7-407e-9c89-e49dd916e1d6 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.247681 Jul 26 03:15:57.577154 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 318/652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:57 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:58.419133 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:58.419786 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:58.428802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:58.429376 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:58.430299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:58.430827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:58.576754 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:58.585604 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:58.587117 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:58.588285 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9e9049f7-a94f-43e1-b9ac-c752dbd4a332 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1721 microversion: 2.20 time: 0.173610 Jul 26 03:15:58.588835 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 335/653] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:58 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:58.597691 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:58.598288 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:58.605193 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:58.605650 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:58.606395 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:58.606816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:58.752925 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:58.761278 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a335b2fa-41e5-4009-8575-bb0e68c96b25 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.167428 Jul 26 03:15:58.762129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 319/654] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:58 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:15:59.611865 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:59.612462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:59.619509 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:59.619950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:59.620697 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:59.621131 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:59.754108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:59.763105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:59.764625 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:59.765825 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7a37490a-5f7d-4ea0-979c-bc63700e7552 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1721 microversion: 2.20 time: 0.157894 Jul 26 03:15:59.766383 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 336/655] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:15:59 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:15:59.781730 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:15:59.782308 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:15:59.789071 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:59.789508 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:59.790257 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:15:59.790681 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:15:59.925917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:15:59.934307 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7df85c0f-501d-470b-ab34-04ce5f38380e tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.156410 Jul 26 03:15:59.947109 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 320/656] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:15:59 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:00.793270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:00.794136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:00.805505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:00.806240 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:00.807557 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:00.808269 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:00.813342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=100 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:00.956210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:00.957132 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:00.957738 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:00.964552 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:00.965028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:00.965484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:00.966024 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:00.966305 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:00.966739 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:00.967235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-22a9946f-0361-45cc-955d-0d9841e4bcbd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1724 microversion: 2.20 time: 0.181029 Jul 26 03:16:00.967797 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 337/657] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:00 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:00.989648 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bd91abcf-f3b2-4c8c-9faf-60596a9a331e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "534ba779-8af6-44e4-b620-86c50fff30b5"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:00.996474 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bd91abcf-f3b2-4c8c-9faf-60596a9a331e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:00.998757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd91abcf-f3b2-4c8c-9faf-60596a9a331e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:00.999236 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd91abcf-f3b2-4c8c-9faf-60596a9a331e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:01.000006 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd91abcf-f3b2-4c8c-9faf-60596a9a331e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:01.000428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd91abcf-f3b2-4c8c-9faf-60596a9a331e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:01.110014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:01.118613 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d8b5d82d-311d-463c-b57f-95203d9caa12 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.165653 Jul 26 03:16:01.119248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 321/658] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:00 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:01.288600 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bd91abcf-f3b2-4c8c-9faf-60596a9a331e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302945 Jul 26 03:16:01.289227 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 338/659] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Jul 26 03:16:00 2022] POST /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 03:16:01.422207 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c4ae38ee-a89c-439f-8e04-371ba7ea4236 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:01.422683 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c4ae38ee-a89c-439f-8e04-371ba7ea4236 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:01.429298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ae38ee-a89c-439f-8e04-371ba7ea4236 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:01.429710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ae38ee-a89c-439f-8e04-371ba7ea4236 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:01.430619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ae38ee-a89c-439f-8e04-371ba7ea4236 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:01.431068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c4ae38ee-a89c-439f-8e04-371ba7ea4236 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:01.621384 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-8483df6b-d226-41c8-856c-c180c4129974 req-6d764eda-74b1-4ca5-b3e5-7710aa8bbf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0d48e-9b52-48e2-bf40-30f16f2fd37d", "name": "network-vif-unplugged", "status": "completed", "tag": "9bba44c6-edd4-430c-95db-d19a412c48e7"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:01.634268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-8483df6b-d226-41c8-856c-c180c4129974 req-6d764eda-74b1-4ca5-b3e5-7710aa8bbf42 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:01.634780 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-8483df6b-d226-41c8-856c-c180c4129974 req-6d764eda-74b1-4ca5-b3e5-7710aa8bbf42 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:01.646232 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-8483df6b-d226-41c8-856c-c180c4129974 req-6d764eda-74b1-4ca5-b3e5-7710aa8bbf42 service nova] Creating event network-vif-unplugged:9bba44c6-edd4-430c-95db-d19a412c48e7 for instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d on hv-cinder-85084 Jul 26 03:16:01.651419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-8483df6b-d226-41c8-856c-c180c4129974 req-6d764eda-74b1-4ca5-b3e5-7710aa8bbf42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034251 Jul 26 03:16:01.652286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 339/660] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:16:01.720686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c4ae38ee-a89c-439f-8e04-371ba7ea4236 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-volume_attachments/534ba779-8af6-44e4-b620-86c50fff30b5" status: 202 len: 0 microversion: 2.20 time: 0.302740 Jul 26 03:16:01.721280 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 322/661] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Jul 26 03:16:01 2022] DELETE /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-volume_attachments/534ba779-8af6-44e4-b620-86c50fff30b5 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:16:01.783271 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1d1057f6-73ed-496c-9f2b-9da536c673d7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:01.783907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1d1057f6-73ed-496c-9f2b-9da536c673d7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:01.790201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d1057f6-73ed-496c-9f2b-9da536c673d7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:01.790635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d1057f6-73ed-496c-9f2b-9da536c673d7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:01.791429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d1057f6-73ed-496c-9f2b-9da536c673d7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:01.791861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1d1057f6-73ed-496c-9f2b-9da536c673d7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:01.999089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1d1057f6-73ed-496c-9f2b-9da536c673d7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "POST /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/action" status: 202 len: 0 microversion: 2.20 time: 0.219777 Jul 26 03:16:01.999880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 340/662] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Jul 26 03:16:01 2022] POST /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:16:02.008241 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:02.009411 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:02.016982 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:02.017424 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:02.018595 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:02.019024 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:02.140995 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:02.141596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:02.152277 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:02.152714 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:02.153476 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:02.154076 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:02.156149 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:02.165499 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:02.167015 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:02.168164 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f6ccd159-98ef-493e-a336-a8e7d687669e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1672 microversion: 2.20 time: 0.163892 Jul 26 03:16:02.168707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 323/663] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:02 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:02.324239 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:02.333246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ff91ddf4-e61d-43f6-9560-a09d9bccc025 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.196166 Jul 26 03:16:02.333838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 341/664] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:02 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:16:03.189812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:03.190411 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:03.196917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.197358 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.198477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.198916 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.336771 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:03.345846 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:03.347382 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:03.348556 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4f0fd473-1742-49db-872c-d6a40511f6c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1674 microversion: 2.20 time: 0.162789 Jul 26 03:16:03.349134 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 324/665] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:03 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:03.354566 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:03.355202 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:03.361834 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.362282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.363065 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.363505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.497540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:03.506121 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e74e6a12-d097-444c-b56a-94e75761219b tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1511 microversion: 2.1 time: 0.155432 Jul 26 03:16:03.506715 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 342/666] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:03 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:03.527336 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9f7dd7c9-5fc4-4170-a496-c144f4e57277 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:03.527891 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9f7dd7c9-5fc4-4170-a496-c144f4e57277 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:03.534415 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f7dd7c9-5fc4-4170-a496-c144f4e57277 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.534856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f7dd7c9-5fc4-4170-a496-c144f4e57277 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.535630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f7dd7c9-5fc4-4170-a496-c144f4e57277 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.536056 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f7dd7c9-5fc4-4170-a496-c144f4e57277 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.549580 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:03.618490 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9f7dd7c9-5fc4-4170-a496-c144f4e57277 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "POST /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3/action" status: 202 len: 0 microversion: 2.1 time: 0.095249 Jul 26 03:16:03.620991 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 325/667] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:16:03 2022] POST /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:16:03.628920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:03.629693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:03.638698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.639185 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.640105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:03.640772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:03.896112 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:03.904173 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f8465066-f870-4645-8da4-48e1a5a87ab1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1519 microversion: 2.1 time: 0.279727 Jul 26 03:16:03.904730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 343/668] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:03 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:04.372089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:04.372699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:04.380151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:04.380778 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:04.381543 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:04.381967 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:04.518138 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:04.526781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:04.528286 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:04.529451 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fa449ee4-83f1-4cee-a3c1-cfee1d544a86 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.161385 Jul 26 03:16:04.530221 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 326/669] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:04 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:04.928118 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:04.929763 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:04.940247 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:04.941054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:04.942292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:04.943034 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:05.140899 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:05.148655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d86a1448-0ec7-40ec-b2fe-4228df3713d2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.226021 Jul 26 03:16:05.163926 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 344/670] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:04 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:05.552994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:05.554206 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:05.562757 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:05.563546 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:05.564652 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:05.565307 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:05.778537 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:05.780433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-acaf4035-314a-4e81-9b05-b3ddd537b79a req-5765a1ee-977c-4c73-9e22-4af8bb0ebc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c126b57-79ad-4bd0-9f2a-db16536258e3", "name": "network-vif-unplugged", "status": "completed", "tag": "62b3e7a3-0978-4f57-a2ab-7e3928be96f1"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:05.794829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-acaf4035-314a-4e81-9b05-b3ddd537b79a req-5765a1ee-977c-4c73-9e22-4af8bb0ebc3b service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:05.795307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-acaf4035-314a-4e81-9b05-b3ddd537b79a req-5765a1ee-977c-4c73-9e22-4af8bb0ebc3b service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:05.802476 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:05.806740 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:05.811549 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-31f3e574-fab4-4cbd-9cd2-b88688ed21a1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.259457 Jul 26 03:16:05.812367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 327/671] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:05 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:05.836806 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.compute.server_external_events [req-acaf4035-314a-4e81-9b05-b3ddd537b79a req-5765a1ee-977c-4c73-9e22-4af8bb0ebc3b service nova] Unable to find a host for instance 1c126b57-79ad-4bd0-9f2a-db16536258e3. Dropping event network-vif-unplugged {{(pid=118060) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 03:16:05.837721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-acaf4035-314a-4e81-9b05-b3ddd537b79a req-5765a1ee-977c-4c73-9e22-4af8bb0ebc3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062497 Jul 26 03:16:05.838281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 345/672] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 03:16:06.171237 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:06.171818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:06.177921 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:06.178355 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:06.179151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:06.179571 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:06.319188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:06.327470 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a18c4671-4a96-4ae3-966f-3c1a0a529505 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.160130 Jul 26 03:16:06.328335 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 328/673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:06 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:06.836645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:06.837307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:06.844544 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:06.844935 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:06.845706 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:06.846122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:06.977782 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:06.985772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:06.987286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:06.988462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1332fec7-ff10-47f5-a70d-f5f8edf3f0e3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.155853 Jul 26 03:16:06.989195 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 346/674] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:06 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:07.350776 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:07.352085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:07.358614 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:07.359096 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:07.359879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:07.360300 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:07.495327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:07.504011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-087bb098-003d-447c-9c13-91f518b9979a tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.157686 Jul 26 03:16:07.517491 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 329/675] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:07 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:08.011398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:08.012184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:08.019520 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:08.019970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:08.020747 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:08.021179 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:08.163904 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:08.172622 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:08.174111 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:08.175301 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-63fa4bf2-e183-4c1e-be95-f0fd8278d02f tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.168028 Jul 26 03:16:08.176060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 347/676] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:08 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:08.525599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:08.526208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:08.533436 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:08.533899 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:08.534659 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:08.535181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:08.677933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:08.688989 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-53296d46-724b-4ee4-a9b2-44c297db9e6c tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.167200 Jul 26 03:16:08.689762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 330/677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:08 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:09.198750 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:09.199443 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:09.206997 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:09.207596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:09.208637 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:09.209247 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:09.344818 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:09.353386 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:09.355025 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:09.356206 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1c8f58ab-0029-452c-86ee-70af83930455 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.162003 Jul 26 03:16:09.356829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 348/678] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:09 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:09.710594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:09.712231 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:09.718928 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:09.719475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:09.720246 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:09.720671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:09.856840 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:09.864440 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6e604df9-7627-4936-b3fb-bd5ba165d9b5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.157847 Jul 26 03:16:09.865000 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 331/679] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:09 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:10.379575 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:10.380184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:10.387138 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:10.387597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:10.388372 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:10.388806 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:10.543041 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:10.552101 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:10.564914 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:10.566238 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-aa323b26-f5e4-493e-98a4-d5a19add7d66 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.190724 Jul 26 03:16:10.566853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 349/680] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:10 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:10.886074 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:10.886715 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:10.893845 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:10.894284 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:10.895253 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:10.895686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:11.040857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:11.048702 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b41d0fa0-6c61-429e-99dc-95980d5c52ec tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.166626 Jul 26 03:16:11.049891 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 332/681] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:10 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:11.592265 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:11.593475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:11.599952 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:11.600626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:11.601562 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:11.602241 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:11.799509 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:11.808419 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:11.814403 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:11.817307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4433c595-9a5b-4fa8-9b90-2dcca4cb6b3a tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.228891 Jul 26 03:16:11.817862 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 350/682] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:11 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:12.070484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:12.071131 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:12.078112 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:12.078563 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:12.079354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:12.079787 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:12.253150 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:12.263178 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-591d47d9-8b70-43cd-bf20-155ecc1946a4 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.195780 Jul 26 03:16:12.263178 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 333/683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:12 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:12.842970 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:12.844714 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:12.853398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:12.854084 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:12.854883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:12.855336 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:12.878525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:13.062772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:13.069326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:13.070858 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:13.072035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-36fc730d-509d-4655-b3fa-efa1bafbb4bd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.234253 Jul 26 03:16:13.072944 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 351/684] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:12 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:13.285646 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:13.287638 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:13.294720 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:13.295466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:13.296633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:13.297243 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:13.511994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:13.524694 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f8de1181-58d7-4679-9abc-0ff9fe4b9726 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.244385 Jul 26 03:16:13.525298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 334/685] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:13 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:14.101135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:14.102374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:14.109577 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:14.110092 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:14.110923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:14.111373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:14.288422 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:14.296324 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:14.297806 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:14.299010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b1b88d65-b402-46b6-a284-cb387fa2ccf1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.202602 Jul 26 03:16:14.299571 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 352/686] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:14 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:14.550686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:14.551693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:14.562474 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:14.562929 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:14.563722 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:14.564156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:14.695424 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:14.703856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-09809c29-dc9a-4323-966e-1025aafed661 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1521 microversion: 2.1 time: 0.160385 Jul 26 03:16:14.704435 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 335/687] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:14 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:15.321971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:15.323108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:15.330389 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:15.330827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:15.331633 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:15.332067 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:15.458691 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-453547262", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "networks": [{"uuid": "95714943-b739-4cc7-951c-93ef6a13b1fa"}]}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:15.511982 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] validate_networks() for [('95714943-b739-4cc7-951c-93ef6a13b1fa', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:16:15.528182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:15.537441 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:15.538988 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:15.540216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a3e86016-656a-45fd-821d-77213f0dd5f3 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.222358 Jul 26 03:16:15.540794 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 353/688] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:15 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:15.725192 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:15.727886 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:15.734709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:15.735281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:15.736286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:15.736798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:15.918481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:16:15.919031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:16:15.919422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:16:15.919824 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:16:15.920245 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:16:15.930153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:15.930595 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:15.931428 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:15.931860 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:15.950962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Getting quotas for project 8bd77269b8504984b3e086be66ac9713. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:16:15.955490 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Getting quotas for user c70c080fc8354ccf90391984baf6052f and project 8bd77269b8504984b3e086be66ac9713. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:16:15.967366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:16:15.969799 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:16:16.018461 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fe8a6798-6d95-4752-b24f-95e7d423b831 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563648 Jul 26 03:16:16.019333 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 336/689] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:16:16.030389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8f14e8b6-3dc9-4378-96e7-436091f7edfe tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:16.031046 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-8f14e8b6-3dc9-4378-96e7-436091f7edfe tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:16.101717 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-8f14e8b6-3dc9-4378-96e7-436091f7edfe tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:16.111193 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8f14e8b6-3dc9-4378-96e7-436091f7edfe tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1218 microversion: 2.1 time: 0.084784 Jul 26 03:16:16.111838 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 337/690] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:16 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:16.209890 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:16.219129 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5207869b-f855-4625-b720-1d6530ffe559 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.497734 Jul 26 03:16:16.220077 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 354/691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:15 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:16:16.565873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:16.566710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:16.576287 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:16.576888 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:16.577899 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:16.578477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:16.715837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:16.724370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:16.725945 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:16.727195 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6d410696-3f10-42c4-bb9b-d47c0d8b6fc6 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.166988 Jul 26 03:16:16.727768 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 338/692] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:16 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:17.131558 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:17.132307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:17.138933 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.139407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.140481 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.140680 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.210544 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:17.218462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-032774f5-c464-419a-ab19-4f483efdd564 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1278 microversion: 2.1 time: 0.090767 Jul 26 03:16:17.223129 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 355/693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:17 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:17.241305 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:17.242697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:17.249266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.250015 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.251036 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.251674 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.395003 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:17.402779 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0d444f03-8f0c-435b-8c2f-e469bb53d9cc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.165297 Jul 26 03:16:17.403426 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 339/694] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:17 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:17.475312 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5f6c3900-8220-42f1-9d00-15e35ad5b238 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:17.475810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5f6c3900-8220-42f1-9d00-15e35ad5b238 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:17.481930 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f6c3900-8220-42f1-9d00-15e35ad5b238 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.482379 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f6c3900-8220-42f1-9d00-15e35ad5b238 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.483171 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f6c3900-8220-42f1-9d00-15e35ad5b238 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.483645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5f6c3900-8220-42f1-9d00-15e35ad5b238 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.507266 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5f6c3900-8220-42f1-9d00-15e35ad5b238 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/ips" status: 200 len: 146 microversion: 2.1 time: 0.231522 Jul 26 03:16:17.507825 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 356/695] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:16:17 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/ips => generated 146 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:16:17.759072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:17.759704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:17.784791 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.785259 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.788210 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:17.789152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:17.981453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:17.990105 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:17.991675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:17.992879 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-19e9ec99-dcfc-47fc-8c7f-9d46274867f2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.247122 Jul 26 03:16:17.993647 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 340/696] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:17 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:18.251243 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:18.252666 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:18.260925 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:18.261482 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:18.262352 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:18.262850 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:18.424187 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:18.424802 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:18.431024 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:18.431471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:18.432361 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:18.432793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:18.492086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:18.500422 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bdcbe447-97fa-4345-be13-25a5a69b7954 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1318 microversion: 2.1 time: 0.263356 Jul 26 03:16:18.501115 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 357/697] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:18 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:18.567681 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:18.576189 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6798b1b5-24ce-4e3c-99c2-5fb32c3debc5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.155877 Jul 26 03:16:18.576740 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 341/698] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:18 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:18.700316 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-896263e6-8a73-478b-8109-06037f4d2ebd req-fa87ec40-7491-4339-9f89-a14407a8b5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef280c7-6724-4574-9c5e-93236d7c63fa", "tag": "6424f09f-5b81-4a11-931e-dc12f6472a63"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:18.710034 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-896263e6-8a73-478b-8109-06037f4d2ebd req-fa87ec40-7491-4339-9f89-a14407a8b5bf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:18.710459 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-896263e6-8a73-478b-8109-06037f4d2ebd req-fa87ec40-7491-4339-9f89-a14407a8b5bf service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:18.722775 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-896263e6-8a73-478b-8109-06037f4d2ebd req-fa87ec40-7491-4339-9f89-a14407a8b5bf service nova] Creating event network-changed:6424f09f-5b81-4a11-931e-dc12f6472a63 for instance cef280c7-6724-4574-9c5e-93236d7c63fa on hv-cinder-85084 Jul 26 03:16:18.727875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-896263e6-8a73-478b-8109-06037f4d2ebd req-fa87ec40-7491-4339-9f89-a14407a8b5bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091665 Jul 26 03:16:18.728463 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 358/699] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:18.923967 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7d98c350-7300-4fb5-ad63-b3156bfeb723 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f801bc87-e062-4dd0-8095-72d5d49d9d3d"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:18.926423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7d98c350-7300-4fb5-ad63-b3156bfeb723 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:18.932955 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d98c350-7300-4fb5-ad63-b3156bfeb723 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:18.933395 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d98c350-7300-4fb5-ad63-b3156bfeb723 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:18.934154 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d98c350-7300-4fb5-ad63-b3156bfeb723 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:18.934580 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7d98c350-7300-4fb5-ad63-b3156bfeb723 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.006503 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:19.016255 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:19.018136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:19.024951 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:19.026066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.026838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:19.027965 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.161440 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:19.169815 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:19.171440 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:19.172601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0681578-be6c-4233-89b5-ede606771eba tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.160760 Jul 26 03:16:19.173160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 359/700] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:19 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:19.526213 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:19.527218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:19.535431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:19.535884 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.536647 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:19.537076 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.664635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:19.672484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-28377fb2-a17e-407f-bf1d-7ef1c106ff62 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1318 microversion: 2.1 time: 0.152859 Jul 26 03:16:19.673095 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 360/701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:19 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:19.677665 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:19.678225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:19.685202 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:19.685369 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.686221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:19.686706 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.827173 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:19.834922 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-920395f2-945c-41eb-9a9f-9495f14d81e0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.160781 Jul 26 03:16:19.835496 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 361/702] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:19 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:19.943759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-ce43dbb0-321c-4049-9b36-877fcaa82c05 req-dc0cfb94-0819-4910-a3ea-fea37c7a357e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0d48e-9b52-48e2-bf40-30f16f2fd37d", "name": "network-vif-plugged", "status": "completed", "tag": "9bba44c6-edd4-430c-95db-d19a412c48e7"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:19.957517 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ce43dbb0-321c-4049-9b36-877fcaa82c05 req-dc0cfb94-0819-4910-a3ea-fea37c7a357e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:19.958028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-ce43dbb0-321c-4049-9b36-877fcaa82c05 req-dc0cfb94-0819-4910-a3ea-fea37c7a357e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:19.973027 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-ce43dbb0-321c-4049-9b36-877fcaa82c05 req-dc0cfb94-0819-4910-a3ea-fea37c7a357e service nova] Creating event network-vif-plugged:9bba44c6-edd4-430c-95db-d19a412c48e7 for instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d on hv-cinder-85084 Jul 26 03:16:19.979280 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-ce43dbb0-321c-4049-9b36-877fcaa82c05 req-dc0cfb94-0819-4910-a3ea-fea37c7a357e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039233 Jul 26 03:16:19.980374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 362/703] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:16:20.070673 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7d98c350-7300-4fb5-ad63-b3156bfeb723 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.150004 Jul 26 03:16:20.071880 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 342/704] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:16:18 2022] POST /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments => generated 194 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:20.196303 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:20.196996 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:20.203980 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:20.204424 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:20.205193 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:20.205680 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:20.389033 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:20.397538 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:20.399086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:20.400293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d3142838-c994-47b5-8d2d-ac003eb30ac7 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.208484 Jul 26 03:16:20.400830 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 363/705] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:20 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:20.696499 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:20.697717 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:20.706022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:20.706465 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:20.707270 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:20.707701 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:20.852393 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:20.857256 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:20.858277 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:20.860860 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6e08467b-0aa1-47bf-a319-a804c5ceb17c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1318 microversion: 2.1 time: 0.170245 Jul 26 03:16:20.861474 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 343/706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:20 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:20.865705 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:20.866150 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:20.866910 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:20.867371 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:20.998119 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:21.006379 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8961894d-98b5-4af1-9965-7719236b59f5 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.153691 Jul 26 03:16:21.006902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 364/707] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:20 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:21.425218 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:21.425788 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:21.432773 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:21.433219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:21.433973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:21.434402 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:21.563702 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:21.571933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:21.573792 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:21.574966 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bffa92e1-b768-42ec-bda3-0565cb5b6652 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.153939 Jul 26 03:16:21.575535 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 344/708] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:21 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:21.676309 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-400f67a7-a18c-4eb9-991b-e8d89864619a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:21.676801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-400f67a7-a18c-4eb9-991b-e8d89864619a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:21.682926 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400f67a7-a18c-4eb9-991b-e8d89864619a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:21.683420 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400f67a7-a18c-4eb9-991b-e8d89864619a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:21.684166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400f67a7-a18c-4eb9-991b-e8d89864619a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:21.684567 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-400f67a7-a18c-4eb9-991b-e8d89864619a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:21.708339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-400f67a7-a18c-4eb9-991b-e8d89864619a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/ips" status: 200 len: 149 microversion: 2.1 time: 0.137021 Jul 26 03:16:21.709098 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 365/709] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:16:21 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/ips => generated 149 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:16:21.881759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:21.882682 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:21.888780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:21.889471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:21.890394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:21.890822 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:22.028545 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:22.029750 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:22.036293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:22.036759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:22.037510 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:22.038080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:22.058514 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:22.066697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e7275ea2-2542-4321-83a6-81a2d3474320 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1318 microversion: 2.1 time: 0.188828 Jul 26 03:16:22.067484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 345/710] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:21 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:22.188494 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:22.196333 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-24713312-379e-4683-9d0a-cb669d9207b1 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.172530 Jul 26 03:16:22.197128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 366/711] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:22 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:22.598092 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:22.598672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:22.605269 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:22.605716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:22.606453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:22.606876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:22.740940 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:22.749117 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:22.750676 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:22.751836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-be1c758d-6c1c-4658-8569-e4805982eb93 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1730 microversion: 2.20 time: 0.157712 Jul 26 03:16:22.752579 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 346/712] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:22 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:23.073331 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4c9e39e0-1653-40a0-8f04-e124d3cee351 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71f114d-e63d-4347-b573-e3b166f94ee5"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:23.075796 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4c9e39e0-1653-40a0-8f04-e124d3cee351 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:23.078329 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=76 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:23.084126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e39e0-1653-40a0-8f04-e124d3cee351 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.084565 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e39e0-1653-40a0-8f04-e124d3cee351 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.085321 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e39e0-1653-40a0-8f04-e124d3cee351 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.085778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4c9e39e0-1653-40a0-8f04-e124d3cee351 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.088628 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:23.089233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:23.096087 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.096533 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.097310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.097739 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.238390 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:23.246370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ffefcd99-d492-48e5-a0cb-da668cb6f53d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1318 microversion: 2.1 time: 0.161666 Jul 26 03:16:23.247102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 347/713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:23 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:23.251470 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:23.252097 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:23.258470 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.259183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.259953 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.260382 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.350658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4c9e39e0-1653-40a0-8f04-e124d3cee351 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "POST /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281651 Jul 26 03:16:23.351705 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 367/714] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:16:23 2022] POST /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:23.399253 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:23.414557 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fddfac91-6f65-47ce-b114-e8fe18e6c5f9 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.166482 Jul 26 03:16:23.415401 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 348/715] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:23 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:23.776035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:23.776737 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:23.783876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.784984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.785758 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.786182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.923900 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-967ece84-368a-4bb0-9e53-41b8a502007f req-66bd106f-4083-4cd3-903f-1b7eed752e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef280c7-6724-4574-9c5e-93236d7c63fa", "name": "network-vif-plugged", "status": "completed", "tag": "6424f09f-5b81-4a11-931e-dc12f6472a63"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:23.929171 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:23.930169 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:23.932981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:23.936036 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-967ece84-368a-4bb0-9e53-41b8a502007f req-66bd106f-4083-4cd3-903f-1b7eed752e39 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:23.936508 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-967ece84-368a-4bb0-9e53-41b8a502007f req-66bd106f-4083-4cd3-903f-1b7eed752e39 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:23.940515 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:23.942889 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:23.944089 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d1f47f9f-d971-48c4-9c1e-caa99d6fb125 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1717 microversion: 2.20 time: 0.172496 Jul 26 03:16:23.944652 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 368/716] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:16:23 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:16:23.949252 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-967ece84-368a-4bb0-9e53-41b8a502007f req-66bd106f-4083-4cd3-903f-1b7eed752e39 service nova] Creating event network-vif-plugged:6424f09f-5b81-4a11-931e-dc12f6472a63 for instance cef280c7-6724-4574-9c5e-93236d7c63fa on hv-cinder-85084 Jul 26 03:16:23.954242 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-967ece84-368a-4bb0-9e53-41b8a502007f req-66bd106f-4083-4cd3-903f-1b7eed752e39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113424 Jul 26 03:16:23.954896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 349/717] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:24.270004 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:24.270618 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:24.278605 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:24.279048 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:24.279829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:24.280366 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:24.419715 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:24.427596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-05445b19-0f29-4b1e-9e44-2271d8b215ff tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1318 microversion: 2.1 time: 0.161595 Jul 26 03:16:24.428169 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 369/718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:24 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:24.437461 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:24.438285 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:24.444789 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:24.445382 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:24.446155 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:24.446576 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:24.593929 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:24.604459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6cfa9d96-c77a-4cc7-8556-f67f0304d301 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.172047 Jul 26 03:16:24.605012 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 350/719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:24 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:25.448931 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:25.449605 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:25.456487 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:25.456929 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:25.457682 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:25.458111 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:25.586037 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:25.594275 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-95a6e70d-a20a-4b8e-bfba-79ba1be861d3 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1507 microversion: 2.1 time: 0.149574 Jul 26 03:16:25.594816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 370/720] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:25 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:25.636423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:25.637045 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:25.647562 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:25.649404 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:25.650180 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:25.650780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:25.795933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:25.806787 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6ca08b6b-3817-411a-9cd6-bd5c4c4f3ddd tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.183339 Jul 26 03:16:25.810979 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 351/721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:25 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:26.828185 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:26.828732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:26.835745 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:26.836181 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:26.836953 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:26.837372 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:26.971893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:26.980221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d7053b63-d36d-46f2-a5b6-0a0bb6dc77b2 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.155991 Jul 26 03:16:26.980776 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 371/722] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:26 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:16:27.648276 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4def84dc-653d-4d3b-904d-72ac8a379028 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:27.650816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4def84dc-653d-4d3b-904d-72ac8a379028 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:27.654404 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:27.655555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=8 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:27.661186 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4def84dc-653d-4d3b-904d-72ac8a379028 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:27.661917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4def84dc-653d-4d3b-904d-72ac8a379028 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:27.662416 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4def84dc-653d-4d3b-904d-72ac8a379028 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:27.662818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4def84dc-653d-4d3b-904d-72ac8a379028 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:27.695629 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4def84dc-653d-4d3b-904d-72ac8a379028 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051471 Jul 26 03:16:27.696185 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 352/723] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:27 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:27.707506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-941ef252-0e58-4501-8818-c8287e86ac6d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:27.708316 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-941ef252-0e58-4501-8818-c8287e86ac6d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:27.714370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-941ef252-0e58-4501-8818-c8287e86ac6d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:27.714833 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-941ef252-0e58-4501-8818-c8287e86ac6d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:27.715614 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-941ef252-0e58-4501-8818-c8287e86ac6d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:27.716032 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-941ef252-0e58-4501-8818-c8287e86ac6d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:27.747047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-941ef252-0e58-4501-8818-c8287e86ac6d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/f801bc87-e062-4dd0-8095-72d5d49d9d3d" status: 200 len: 194 microversion: 2.1 time: 0.042683 Jul 26 03:16:27.747047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 372/724] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Jul 26 03:16:27 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/f801bc87-e062-4dd0-8095-72d5d49d9d3d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:27.836013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-c28dc38b-b3d6-4c1a-aecd-e31daad798c6 req-c9b79783-393f-4e4c-8b53-c9afa27290b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c126b57-79ad-4bd0-9f2a-db16536258e3", "name": "network-vif-plugged", "status": "completed", "tag": "62b3e7a3-0978-4f57-a2ab-7e3928be96f1"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:27.853833 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-c28dc38b-b3d6-4c1a-aecd-e31daad798c6 req-c9b79783-393f-4e4c-8b53-c9afa27290b4 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:27.854260 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-c28dc38b-b3d6-4c1a-aecd-e31daad798c6 req-c9b79783-393f-4e4c-8b53-c9afa27290b4 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:27.869129 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-c28dc38b-b3d6-4c1a-aecd-e31daad798c6 req-c9b79783-393f-4e4c-8b53-c9afa27290b4 service nova] Creating event network-vif-plugged:62b3e7a3-0978-4f57-a2ab-7e3928be96f1 for instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 on hv-cinder-85084 Jul 26 03:16:27.874079 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-c28dc38b-b3d6-4c1a-aecd-e31daad798c6 req-c9b79783-393f-4e4c-8b53-c9afa27290b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043319 Jul 26 03:16:27.875026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 353/725] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:28.002689 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:28.004341 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:28.019622 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:28.020073 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:28.021035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:28.021464 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:28.239672 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:28.248062 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f1340c54-fa67-415f-b6c1-402bbe5dcd06 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.249695 Jul 26 03:16:28.248700 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 373/726] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:27 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:29.150528 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9f9f09a3-0d27-4135-8c81-5502c7849786 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26db7d5e-21f2-41c9-bc80-680359efa6de"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:29.153004 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9f9f09a3-0d27-4135-8c81-5502c7849786 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:29.159896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f9f09a3-0d27-4135-8c81-5502c7849786 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:29.160333 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f9f09a3-0d27-4135-8c81-5502c7849786 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:29.161086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f9f09a3-0d27-4135-8c81-5502c7849786 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:29.161506 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f9f09a3-0d27-4135-8c81-5502c7849786 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:29.269713 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:29.270231 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:29.277452 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:29.277893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:29.278650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:29.279128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:29.420274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:29.427983 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c0487910-19d5-42fe-8aa9-f7c2250cae6f tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1577 microversion: 2.1 time: 0.162184 Jul 26 03:16:29.428543 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 374/727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:29 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:16:29.926509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9f9f09a3-0d27-4135-8c81-5502c7849786 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "POST /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780169 Jul 26 03:16:29.927308 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 354/728] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:16:29 2022] POST /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:30.453881 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:30.454492 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:30.461901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:30.462343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:30.463158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:30.463589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:30.602450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:30.610451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5b052399-b9ab-4e65-8916-b7fcbd213aa0 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1564 microversion: 2.1 time: 0.163306 Jul 26 03:16:30.611045 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 375/729] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:30 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:33.151734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:33.152421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:33.159531 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:33.159968 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:33.160726 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:33.161201 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:33.244147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lazy-loading 'services' on Instance uuid 674e6a56-e2e2-4ad6-98ac-f931a03e5dec {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:16:33.317984 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-32713aeb-25ef-4428-9e52-504f956753ed tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments/d71f114d-e63d-4347-b573-e3b166f94ee5" status: 202 len: 0 microversion: 2.1 time: 0.170456 Jul 26 03:16:33.318596 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 355/730] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:16:33 2022] DELETE /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments/d71f114d-e63d-4347-b573-e3b166f94ee5 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:16:33.328185 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7bb62a3e-72bd-4233-89d7-08092f20385b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:33.330726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7bb62a3e-72bd-4233-89d7-08092f20385b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:33.338015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb62a3e-72bd-4233-89d7-08092f20385b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:33.338495 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb62a3e-72bd-4233-89d7-08092f20385b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:33.339504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb62a3e-72bd-4233-89d7-08092f20385b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:33.339982 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb62a3e-72bd-4233-89d7-08092f20385b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:33.376559 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7bb62a3e-72bd-4233-89d7-08092f20385b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053138 Jul 26 03:16:33.377124 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 376/731] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:33 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:16:34.390710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bcb87144-b808-4e79-b689-8e70e1591b31 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:34.393282 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bcb87144-b808-4e79-b689-8e70e1591b31 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:34.400849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bcb87144-b808-4e79-b689-8e70e1591b31 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:34.401378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bcb87144-b808-4e79-b689-8e70e1591b31 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:34.402154 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bcb87144-b808-4e79-b689-8e70e1591b31 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:34.402631 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bcb87144-b808-4e79-b689-8e70e1591b31 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:34.433434 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bcb87144-b808-4e79-b689-8e70e1591b31 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047839 Jul 26 03:16:34.434261 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 356/732] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:34 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:35.450536 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-cdee6c6d-87d9-4725-ae74-8a1f248e8e17 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:35.454113 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-cdee6c6d-87d9-4725-ae74-8a1f248e8e17 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:35.463667 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cdee6c6d-87d9-4725-ae74-8a1f248e8e17 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:35.464109 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cdee6c6d-87d9-4725-ae74-8a1f248e8e17 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:35.464859 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cdee6c6d-87d9-4725-ae74-8a1f248e8e17 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:35.465286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-cdee6c6d-87d9-4725-ae74-8a1f248e8e17 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:35.496434 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-cdee6c6d-87d9-4725-ae74-8a1f248e8e17 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053038 Jul 26 03:16:35.496991 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 377/733] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:35 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:36.512978 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4faafac3-2e8e-49f7-a20a-15031fae0b88 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:36.515809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4faafac3-2e8e-49f7-a20a-15031fae0b88 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:36.523339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4faafac3-2e8e-49f7-a20a-15031fae0b88 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:36.523785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4faafac3-2e8e-49f7-a20a-15031fae0b88 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:36.524543 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4faafac3-2e8e-49f7-a20a-15031fae0b88 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:36.524974 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4faafac3-2e8e-49f7-a20a-15031fae0b88 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:36.539558 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:36.556606 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4faafac3-2e8e-49f7-a20a-15031fae0b88 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050154 Jul 26 03:16:36.557172 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 357/734] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:36 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:37.574937 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-389a385c-b38d-40e9-bac9-d2d46a19541b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:37.578473 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-389a385c-b38d-40e9-bac9-d2d46a19541b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:37.589484 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-389a385c-b38d-40e9-bac9-d2d46a19541b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:37.590119 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-389a385c-b38d-40e9-bac9-d2d46a19541b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:37.591460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-389a385c-b38d-40e9-bac9-d2d46a19541b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:37.592167 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-389a385c-b38d-40e9-bac9-d2d46a19541b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:37.625265 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-389a385c-b38d-40e9-bac9-d2d46a19541b tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057356 Jul 26 03:16:37.625810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 378/735] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:37 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:38.642573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fc66420d-1a68-4de5-b8ae-fe13bd07d5cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:38.646021 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fc66420d-1a68-4de5-b8ae-fe13bd07d5cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:38.653896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc66420d-1a68-4de5-b8ae-fe13bd07d5cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:38.654336 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc66420d-1a68-4de5-b8ae-fe13bd07d5cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:38.655252 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc66420d-1a68-4de5-b8ae-fe13bd07d5cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:38.655682 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fc66420d-1a68-4de5-b8ae-fe13bd07d5cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:38.686593 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fc66420d-1a68-4de5-b8ae-fe13bd07d5cb tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050987 Jul 26 03:16:38.687160 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 358/736] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:38 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:39.703514 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-720089b1-9121-438c-889d-e5677f83dfad tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:39.706941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-720089b1-9121-438c-889d-e5677f83dfad tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:39.717770 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-720089b1-9121-438c-889d-e5677f83dfad tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:39.718481 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-720089b1-9121-438c-889d-e5677f83dfad tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:39.719788 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-720089b1-9121-438c-889d-e5677f83dfad tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:39.720495 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-720089b1-9121-438c-889d-e5677f83dfad tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:39.753274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-720089b1-9121-438c-889d-e5677f83dfad tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056701 Jul 26 03:16:39.753872 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 379/737] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:39 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:40.705212 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-935bba8f-4d4a-4dcf-b867-471ca5c0c8ea tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:40.707507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-935bba8f-4d4a-4dcf-b867-471ca5c0c8ea tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:40.713798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-935bba8f-4d4a-4dcf-b867-471ca5c0c8ea tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.714244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-935bba8f-4d4a-4dcf-b867-471ca5c0c8ea tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.715040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-935bba8f-4d4a-4dcf-b867-471ca5c0c8ea tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.715475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-935bba8f-4d4a-4dcf-b867-471ca5c0c8ea tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.744815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-935bba8f-4d4a-4dcf-b867-471ca5c0c8ea tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044111 Jul 26 03:16:40.745374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 359/738] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:40 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:40.766303 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-442d5132-8603-43df-97ca-8681430766c5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:40.768640 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-442d5132-8603-43df-97ca-8681430766c5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:40.777418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-442d5132-8603-43df-97ca-8681430766c5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.777418 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-442d5132-8603-43df-97ca-8681430766c5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.778635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-442d5132-8603-43df-97ca-8681430766c5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.779112 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-442d5132-8603-43df-97ca-8681430766c5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.807906 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-442d5132-8603-43df-97ca-8681430766c5 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046064 Jul 26 03:16:40.814020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 380/739] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:40 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:16:40.865586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-514968fd-87b2-4089-9fa8-2af730d5b06f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66a082dc-fd3e-4038-a1bb-a222fa1ad9ab", "device": "/dev/sdb"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:40.869329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-514968fd-87b2-4089-9fa8-2af730d5b06f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:40.875876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-514968fd-87b2-4089-9fa8-2af730d5b06f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.876686 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-514968fd-87b2-4089-9fa8-2af730d5b06f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.877525 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-514968fd-87b2-4089-9fa8-2af730d5b06f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.877649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:40.878112 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-514968fd-87b2-4089-9fa8-2af730d5b06f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.878263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:40.886370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.886992 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.887692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:40.888012 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:40.914303 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:16:40.990278 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7b27eb0e-1230-4099-b5e7-de23f3d6dfda tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 204 len: 0 microversion: 2.1 time: 0.116114 Jul 26 03:16:40.991053 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 381/740] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:16:40 2022] DELETE /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:16:40.997060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-12296aa1-d7b7-4b66-8116-a2963445d6cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:40.997583 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-12296aa1-d7b7-4b66-8116-a2963445d6cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:41.004015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12296aa1-d7b7-4b66-8116-a2963445d6cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:41.004473 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12296aa1-d7b7-4b66-8116-a2963445d6cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:41.005246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12296aa1-d7b7-4b66-8116-a2963445d6cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:41.005699 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-12296aa1-d7b7-4b66-8116-a2963445d6cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:41.034026 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-12296aa1-d7b7-4b66-8116-a2963445d6cf tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/f801bc87-e062-4dd0-8095-72d5d49d9d3d" status: 200 len: 194 microversion: 2.1 time: 0.041709 Jul 26 03:16:41.034603 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 382/741] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Jul 26 03:16:40 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/f801bc87-e062-4dd0-8095-72d5d49d9d3d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:41.038859 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:41.039477 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:41.045053 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:41.045496 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:41.046246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:41.046681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:41.182831 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:41.186372 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:41.190974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b2d88238-5f5b-4117-bcf4-d6d404435089 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1681 microversion: 2.1 time: 0.155390 Jul 26 03:16:41.191540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 383/742] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:41 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:41.196373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:41.197243 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:41.203719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:41.204159 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:41.204917 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:41.205350 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:41.286412 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lazy-loading 'services' on Instance uuid 3492df7b-e7b3-45fe-a70b-df0e94233036 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:16:41.365182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f097c672-85f8-4b41-b73c-f4afb62a238a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/f801bc87-e062-4dd0-8095-72d5d49d9d3d" status: 202 len: 0 microversion: 2.1 time: 0.172010 Jul 26 03:16:41.366061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 384/743] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:16:41 2022] DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/f801bc87-e062-4dd0-8095-72d5d49d9d3d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:16:42.218424 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:42.219528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:42.230821 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:42.231601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:42.232833 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:42.233538 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:42.370936 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:42.378768 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bd286e3b-f15e-4a07-b3f2-bdeee48cca79 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1681 microversion: 2.1 time: 0.167571 Jul 26 03:16:42.379362 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 385/744] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:42 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:42.622515 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-514968fd-87b2-4089-9fa8-2af730d5b06f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "POST /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.760957 Jul 26 03:16:42.623302 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 360/745] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:16:40 2022] POST /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa/os-volume_attachments => generated 194 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:43.400556 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:43.401220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:43.408029 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:43.408678 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:43.409753 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:43.410251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:43.588694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:43.597050 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d9b4b349-63db-49a3-b8ff-f7ee91688a7c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1681 microversion: 2.1 time: 0.200818 Jul 26 03:16:43.597617 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 386/746] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:43 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:44.561128 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-0dd37288-37fa-45e8-95c1-1ecec92a1994 req-8d7881e2-b21f-41ca-aa3b-d28ca022868b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "674e6a56-e2e2-4ad6-98ac-f931a03e5dec", "name": "network-vif-deleted", "tag": "31d7b859-ab14-4275-adc3-9ff278f6873a"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:16:44.577063 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-0dd37288-37fa-45e8-95c1-1ecec92a1994 req-8d7881e2-b21f-41ca-aa3b-d28ca022868b service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:44.577900 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-0dd37288-37fa-45e8-95c1-1ecec92a1994 req-8d7881e2-b21f-41ca-aa3b-d28ca022868b service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:44.590856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-0dd37288-37fa-45e8-95c1-1ecec92a1994 req-8d7881e2-b21f-41ca-aa3b-d28ca022868b service nova] Creating event network-vif-deleted:31d7b859-ab14-4275-adc3-9ff278f6873a for instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec on hv-cinder-85084 Jul 26 03:16:44.596638 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-0dd37288-37fa-45e8-95c1-1ecec92a1994 req-8d7881e2-b21f-41ca-aa3b-d28ca022868b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043011 Jul 26 03:16:44.597240 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 361/747] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:44.633455 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:44.634581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:44.636352 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bb550eb1-0caa-437e-88b7-4726a017b47b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:44.636947 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bb550eb1-0caa-437e-88b7-4726a017b47b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:44.641997 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:44.642707 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:44.643721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:44.644190 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb550eb1-0caa-437e-88b7-4726a017b47b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:44.644488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:44.645329 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb550eb1-0caa-437e-88b7-4726a017b47b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:44.646410 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb550eb1-0caa-437e-88b7-4726a017b47b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:44.646843 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bb550eb1-0caa-437e-88b7-4726a017b47b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:44.683236 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bb550eb1-0caa-437e-88b7-4726a017b47b tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/26db7d5e-21f2-41c9-bc80-680359efa6de" status: 200 len: 194 microversion: 2.1 time: 0.057609 Jul 26 03:16:44.684366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 362/748] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Jul 26 03:16:44 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/26db7d5e-21f2-41c9-bc80-680359efa6de => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:16:44.695940 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:44.697447 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:44.714931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:44.715703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:44.716666 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:44.717383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:44.846382 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lazy-loading 'services' on Instance uuid 3492df7b-e7b3-45fe-a70b-df0e94233036 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:16:44.938305 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fe09e458-5103-47e6-b954-be2781644b08 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/26db7d5e-21f2-41c9-bc80-680359efa6de" status: 202 len: 0 microversion: 2.1 time: 0.247681 Jul 26 03:16:44.942204 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 363/749] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:16:44 2022] DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments/26db7d5e-21f2-41c9-bc80-680359efa6de => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:16:45.055979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d3fd2b3c6cd47019e15fbf959d47381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d8d482c37d849cf8bdf035e110e0f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:45.064118 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5e34d31c-b42e-45ee-a36a-8b10c7969f9a tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 200 len: 1327 microversion: 2.1 time: 0.443238 Jul 26 03:16:45.066693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 387/750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:44 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 1327 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:46.090039 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:46.090764 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:46.100863 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:46.101296 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:46.102140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:46.102569 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:46.118046 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec HTTP/1.1 Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:16:46.119808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:46.121343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '674e6a56-e2e2-4ad6-98ac-f931a03e5dec'} Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:46.122354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:46.125122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:46.127418 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:46.127418 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-52ebf363-1b01-4bd3-a86c-b939d6090b84 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 404 len: 111 microversion: 2.1 time: 0.038199 Jul 26 03:16:46.127418 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 364/751] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:46 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:46.132141 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a1774039-e1b5-448c-88e4-678d3fac11dc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '.version_select at 0x7f5f79605ee0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:46.155182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a1774039-e1b5-448c-88e4-678d3fac11dc tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778458967" status: 202 len: 0 microversion: 2.1 time: 0.026720 Jul 26 03:16:46.155828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 388/752] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Jul 26 03:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778458967 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:16:47.943965 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:47.944436 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:47.951597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:47.952040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:47.952786 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:47.953217 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:47.966764 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec HTTP/1.1 Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:16:47.968327 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:47.969797 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '674e6a56-e2e2-4ad6-98ac-f931a03e5dec'} Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:47.970623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:47.971817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:47.972968 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:47.972968 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b05f4525-6b53-458a-9130-18288b88f464 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 404 len: 111 microversion: 2.1 time: 0.029728 Jul 26 03:16:47.972968 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 365/753] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:16:47 2022] DELETE /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:47.979170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:47.979757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 674e6a56-e2e2-4ad6-98ac-f931a03e5dec] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:47.986810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:47.987293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:47.988108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:47.988508 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:48.002355 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec HTTP/1.1 Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:16:48.004080 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:48.005589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '674e6a56-e2e2-4ad6-98ac-f931a03e5dec'} Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:48.006488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. Jul 26 03:16:48.007984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:48.014636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance 674e6a56-e2e2-4ad6-98ac-f931a03e5dec could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:48.014636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f2c3d221-7ede-4f22-9ad4-3aa778351b70 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec" status: 404 len: 111 microversion: 2.1 time: 0.030918 Jul 26 03:16:48.014636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 389/754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:47 2022] GET /compute/v2.1/servers/674e6a56-e2e2-4ad6-98ac-f931a03e5dec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 03:16:49.168188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:49.168729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:49.175957 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.176400 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.177321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.177742 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.191740 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 HTTP/1.1 Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:16:49.193360 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.194828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606'} Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:49.195725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.197555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.198977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:49.198977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d185ee48-045e-4207-bae8-450f8a78469c tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 404 len: 111 microversion: 2.1 time: 0.033461 Jul 26 03:16:49.198977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 366/755] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:16:49 2022] DELETE /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:49.205850 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:49.206475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:49.213709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.214158 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.215133 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.215570 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.231725 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 HTTP/1.1 Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:16:49.233276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.234798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606'} Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:49.235719 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. Jul 26 03:16:49.237201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.238616 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:49.238616 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b96b7019-8376-4870-a8ce-9dad979cdae9 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606" status: 404 len: 111 microversion: 2.1 time: 0.034855 Jul 26 03:16:49.238616 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 390/756] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:49 2022] GET /compute/v2.1/servers/a9cbf5a2-12e6-472a-9b7c-f8ca4d9f6606 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:49.243198 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:49.244306 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:49.250298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.250738 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.251489 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.251915 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.266978 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 HTTP/1.1 Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:16:49.268509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.270111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'd09c4f22-568d-47e5-85e7-0df4402648a5'} Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:49.270986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.272406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.273870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:49.273870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c1719f63-9b72-4ab7-8d71-3c27312f81b8 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 404 len: 111 microversion: 2.1 time: 0.030553 Jul 26 03:16:49.273870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 367/757] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:16:49 2022] DELETE /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:49.279510 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:49.280140 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: d09c4f22-568d-47e5-85e7-0df4402648a5] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:49.286242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.286731 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.287512 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:49.287946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:49.301749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 HTTP/1.1 Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:16:49.303292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.304828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'd09c4f22-568d-47e5-85e7-0df4402648a5'} Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:49.305658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. Jul 26 03:16:49.306976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:49.308100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance d09c4f22-568d-47e5-85e7-0df4402648a5 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:49.308100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-368dab96-24d7-4245-b489-0535048a2279 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5" status: 404 len: 111 microversion: 2.1 time: 0.029416 Jul 26 03:16:49.308100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 391/758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:49 2022] GET /compute/v2.1/servers/d09c4f22-568d-47e5-85e7-0df4402648a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:50.450449 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:50.450991 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:50.457821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:50.458273 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:50.459058 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:50.459485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:50.473826 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 HTTP/1.1 Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:16:50.475388 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.476633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '32e66410-316a-4d20-a6f8-c248fb10a534'} Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:50.477345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.478479 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.479663 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:50.479663 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-89c61ece-722b-40b3-ae58-929c86811778 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 404 len: 111 microversion: 2.1 time: 0.030869 Jul 26 03:16:50.479663 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 368/759] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:16:50 2022] DELETE /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:50.488205 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:50.488898 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] [instance: 32e66410-316a-4d20-a6f8-c248fb10a534] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:50.496876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:50.497325 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:50.498083 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:50.498512 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:50.517391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] HTTP exception thrown: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Request method failure captured: Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 HTTP/1.1 Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tLe5WHfUViIAmnlBqRX7YLgwAID7kP1Sh97msMExcKMbltjhvBugV1PJY8j10RbX47Ky0eTex4BEFa4zTqrX0voK9w-pgyoiE_od9lDBdjWwjpdXXS1uGZ08Zl0d9gk1DQKmDZTio8YVX7MxTGbB9D7mCbJdJNlyV_ly3Kec9aBII Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:16:50.518979 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9d8d482c37d849cf8bdf035e110e0f34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 9d8d482c37d849cf8bdf035e110e0f34 Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-718220009 Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 9d3fd2b3c6cd47019e15fbf959d47381 Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeNegativeTest-718220009-project Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.520393 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '32e66410-316a-4d20-a6f8-c248fb10a534'} Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:16:50.521217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. Jul 26 03:16:50.522553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:16:50.523837 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] Returning 404 to user: Instance 32e66410-316a-4d20-a6f8-c248fb10a534 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:16:50.523837 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d0dbe7d9-e200-4fc6-b5e7-06eab4667a94 tempest-AttachVolumeNegativeTest-718220009 tempest-AttachVolumeNegativeTest-718220009-project] 10.222.0.42 "GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534" status: 404 len: 111 microversion: 2.1 time: 0.038158 Jul 26 03:16:50.523837 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 392/760] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:50 2022] GET /compute/v2.1/servers/32e66410-316a-4d20-a6f8-c248fb10a534 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:16:51.479076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-03cc6ea0-42fc-4e4a-b384-617efe7e2e6c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:51.481734 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-03cc6ea0-42fc-4e4a-b384-617efe7e2e6c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:51.496748 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03cc6ea0-42fc-4e4a-b384-617efe7e2e6c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.497158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03cc6ea0-42fc-4e4a-b384-617efe7e2e6c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:51.497925 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03cc6ea0-42fc-4e4a-b384-617efe7e2e6c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.498351 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-03cc6ea0-42fc-4e4a-b384-617efe7e2e6c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:51.534858 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-03cc6ea0-42fc-4e4a-b384-617efe7e2e6c tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060215 Jul 26 03:16:51.541154 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 369/761] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:51 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:16:51.654631 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4443af63-b299-4d32-8508-26f2d875a10e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:51.656940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4443af63-b299-4d32-8508-26f2d875a10e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:51.663947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4443af63-b299-4d32-8508-26f2d875a10e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.664386 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4443af63-b299-4d32-8508-26f2d875a10e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:51.665161 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4443af63-b299-4d32-8508-26f2d875a10e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.665593 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4443af63-b299-4d32-8508-26f2d875a10e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:51.694755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4443af63-b299-4d32-8508-26f2d875a10e tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044072 Jul 26 03:16:51.695342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 393/762] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:16:51 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:16:51.757811 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:51.758374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:51.765112 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.765636 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:51.766471 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.767009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:51.791371 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:16:51.873766 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-149a5db7-ae5e-4a55-8b87-6d98f9d8d7b7 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 204 len: 0 microversion: 2.1 time: 0.119403 Jul 26 03:16:51.874370 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 370/763] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:16:51 2022] DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:16:51.883911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:51.884553 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:51.891333 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.891654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:51.892429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:51.892861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:52.033936 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:52.041989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9029d2ac-f210-44e3-8c83-f36784a5093f tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1673 microversion: 2.1 time: 0.162834 Jul 26 03:16:52.042844 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 394/764] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:51 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:53.063604 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:53.079183 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:53.089873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:53.090602 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:53.091557 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:53.092303 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:53.246685 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:53.255151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4ae2094d-a468-4ebf-a976-0448b49d7eb1 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1673 microversion: 2.1 time: 0.195666 Jul 26 03:16:53.255661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 371/765] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:53 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:54.277208 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:54.277726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:54.280203 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:54.286284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:54.286707 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:54.287693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:54.288122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:54.419673 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:54.427777 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-72564cf8-6338-41fa-b9a8-25c3288d17f0 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1673 microversion: 2.1 time: 0.154563 Jul 26 03:16:54.428878 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 395/766] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:54 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:55.450298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:55.450987 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:55.453605 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:16:55.458998 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:55.459449 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:55.460142 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:55.460569 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:55.595346 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:55.605135 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1f4f0b49-5105-43ff-b85f-3563d039feec tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1673 microversion: 2.1 time: 0.159134 Jul 26 03:16:55.606050 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 372/767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:55 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:56.628548 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:56.629853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:56.637467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:56.638137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:56.639460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:56.640127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:56.770077 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:56.777646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-16d7fb41-af52-4fa8-a85a-0c7ec9580509 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1673 microversion: 2.1 time: 0.153565 Jul 26 03:16:56.778214 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 396/768] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:56 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:57.799061 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:57.799666 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:57.806521 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:57.807009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:57.807770 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:57.808239 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:57.959419 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:57.967151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d822e3f2-5932-4ab6-8be6-1ff0dcb8768d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1673 microversion: 2.1 time: 0.171901 Jul 26 03:16:57.967966 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 373/769] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:57 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:16:58.988994 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:16:58.989586 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:16:58.996452 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:58.996893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:58.997642 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:16:58.998086 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:16:59.133048 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:16:59.140820 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-10a038bb-8c01-4eef-a747-c295f16c2a87 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1673 microversion: 2.1 time: 0.155653 Jul 26 03:16:59.141628 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 397/770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:16:58 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:00.042235 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-31f52e7f-3d0f-4475-b7e0-2b96571580b5 req-8496593f-7cd3-46a0-bb68-77bec4112b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3492df7b-e7b3-45fe-a70b-df0e94233036", "name": "network-vif-deleted", "tag": "f962a46d-878a-459e-9839-e85be7e331cc"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:00.054622 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-31f52e7f-3d0f-4475-b7e0-2b96571580b5 req-8496593f-7cd3-46a0-bb68-77bec4112b94 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:00.055494 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-31f52e7f-3d0f-4475-b7e0-2b96571580b5 req-8496593f-7cd3-46a0-bb68-77bec4112b94 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:00.073421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-31f52e7f-3d0f-4475-b7e0-2b96571580b5 req-8496593f-7cd3-46a0-bb68-77bec4112b94 service nova] Creating event network-vif-deleted:f962a46d-878a-459e-9839-e85be7e331cc for instance 3492df7b-e7b3-45fe-a70b-df0e94233036 on hv-cinder-85084 Jul 26 03:17:00.080472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-31f52e7f-3d0f-4475-b7e0-2b96571580b5 req-8496593f-7cd3-46a0-bb68-77bec4112b94 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042169 Jul 26 03:17:00.085341 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 374/771] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:00.170389 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:00.170389 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:00.175940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:00.176439 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:00.177309 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:00.178416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:00.224971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:00.227208 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:00.227667 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lazy-loading 'fault' on Instance uuid 3492df7b-e7b3-45fe-a70b-df0e94233036 {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:17:00.290881 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbdac72f58df4335b3790c5fb1609f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6daba0980548418ea98d4d0cf42ef92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:00.300190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9e628c98-2200-4df5-835a-544545065954 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 200 len: 1327 microversion: 2.1 time: 0.141784 Jul 26 03:17:00.301249 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 398/772] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:00 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:01.323144 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:01.324001 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:01.331133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:01.331558 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:01.332310 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:01.332735 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:01.335395 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:01.349801 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] HTTP exception thrown: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Request method failure captured: Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 HTTP/1.1 Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tAgcw6gS7lcI8gr-yglFGxrTrdWtHqSwzB_f-f8cb4Fx0L63n86hDG_geJq7c2LtkoB26xWpX1OxjpLk6po729CVrz25-qMmKz0Yhs8Y45ZqQu1yfvLroruutlcbuz4L3k0mmzeMHgjp2LFmIe3kSWtpDzLakqXOMvmuqnsCcaxsE Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:17:01.352018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: fbdac72f58df4335b3790c5fb1609f5b Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:01.357809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '3492df7b-e7b3-45fe-a70b-df0e94233036'} Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:01.359519 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:01.360816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:01.362026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Returning 404 to user: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:01.362026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a79e5cba-020f-43e0-bec9-69f9e97a0533 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 404 len: 111 microversion: 2.1 time: 0.035841 Jul 26 03:17:01.362026 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 375/773] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:01 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:01.363528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-02e29d58-a691-4ad8-8479-a81361855487 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '.version_select at 0x7f5f7df37670>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:01.384595 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-02e29d58-a691-4ad8-8479-a81361855487 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126944270" status: 202 len: 0 microversion: 2.1 time: 0.024919 Jul 26 03:17:01.385170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 399/774] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Jul 26 03:17:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126944270 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:17:05.370196 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:05.370808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:05.384274 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:05.385481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:05.386311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:05.386719 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:05.402231 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] HTTP exception thrown: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Request method failure captured: Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 HTTP/1.1 Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tAgcw6gS7lcI8gr-yglFGxrTrdWtHqSwzB_f-f8cb4Fx0L63n86hDG_geJq7c2LtkoB26xWpX1OxjpLk6po729CVrz25-qMmKz0Yhs8Y45ZqQu1yfvLroruutlcbuz4L3k0mmzeMHgjp2LFmIe3kSWtpDzLakqXOMvmuqnsCcaxsE Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:17:05.404068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: fbdac72f58df4335b3790c5fb1609f5b Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.405473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '3492df7b-e7b3-45fe-a70b-df0e94233036'} Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:05.406267 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.407707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.409009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Returning 404 to user: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:05.409009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f6af9792-9563-4e22-a661-79f39bc7a14d tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 404 len: 111 microversion: 2.1 time: 0.039443 Jul 26 03:17:05.409009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 376/775] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:17:05 2022] DELETE /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:05.414552 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:05.415457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: 3492df7b-e7b3-45fe-a70b-df0e94233036] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:05.422359 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:05.422908 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:05.424005 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:05.424534 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:05.438634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] HTTP exception thrown: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Request method failure captured: Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 HTTP/1.1 Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tAgcw6gS7lcI8gr-yglFGxrTrdWtHqSwzB_f-f8cb4Fx0L63n86hDG_geJq7c2LtkoB26xWpX1OxjpLk6po729CVrz25-qMmKz0Yhs8Y45ZqQu1yfvLroruutlcbuz4L3k0mmzeMHgjp2LFmIe3kSWtpDzLakqXOMvmuqnsCcaxsE Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:05.440413 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: fbdac72f58df4335b3790c5fb1609f5b Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.442009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '3492df7b-e7b3-45fe-a70b-df0e94233036'} Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:05.442894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. Jul 26 03:17:05.444343 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:05.445578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Returning 404 to user: Instance 3492df7b-e7b3-45fe-a70b-df0e94233036 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:05.445578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-74faf9af-77d5-4102-a2cd-da4263001dac tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036" status: 404 len: 111 microversion: 2.1 time: 0.031760 Jul 26 03:17:05.445578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 400/776] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:05 2022] GET /compute/v2.1/servers/3492df7b-e7b3-45fe-a70b-df0e94233036 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:06.594554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:06.595076 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:06.601818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:06.602273 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:06.603095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:06.603532 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:06.620633 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] HTTP exception thrown: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Request method failure captured: Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 HTTP/1.1 Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31tAgcw6gS7lcI8gr-yglFGxrTrdWtHqSwzB_f-f8cb4Fx0L63n86hDG_geJq7c2LtkoB26xWpX1OxjpLk6po729CVrz25-qMmKz0Yhs8Y45ZqQu1yfvLroruutlcbuz4L3k0mmzeMHgjp2LFmIe3kSWtpDzLakqXOMvmuqnsCcaxsE Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:17:06.622188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: fbdac72f58df4335b3790c5fb1609f5b Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.623690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'c517b5ca-379c-4830-bc26-021ce1412c76'} Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:06.624530 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.625857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.627312 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Returning 404 to user: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:06.627312 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-71ff30c6-570f-45ce-bbf0-a3f84d359e6a tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 404 len: 111 microversion: 2.1 time: 0.032959 Jul 26 03:17:06.627478 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 377/777] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:17:06 2022] DELETE /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:06.632674 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:06.633453 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] [instance: c517b5ca-379c-4830-bc26-021ce1412c76] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:06.640476 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:06.640997 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:06.641823 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:06.642292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:06.658078 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] HTTP exception thrown: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Request method failure captured: Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 HTTP/1.1 Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31tAgcw6gS7lcI8gr-yglFGxrTrdWtHqSwzB_f-f8cb4Fx0L63n86hDG_geJq7c2LtkoB26xWpX1OxjpLk6po729CVrz25-qMmKz0Yhs8Y45ZqQu1yfvLroruutlcbuz4L3k0mmzeMHgjp2LFmIe3kSWtpDzLakqXOMvmuqnsCcaxsE Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:06.659644 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6daba0980548418ea98d4d0cf42ef92f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 6daba0980548418ea98d4d0cf42ef92f Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeTestJSON-957349954 Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: fbdac72f58df4335b3790c5fb1609f5b Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeTestJSON-957349954-project Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.661270 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'c517b5ca-379c-4830-bc26-021ce1412c76'} Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:06.665601 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. Jul 26 03:17:06.667875 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:06.669515 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] Returning 404 to user: Instance c517b5ca-379c-4830-bc26-021ce1412c76 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:06.669515 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ab5ce6e1-ff4c-4f79-ae15-86e49d7b5097 tempest-AttachVolumeTestJSON-957349954 tempest-AttachVolumeTestJSON-957349954-project] 10.222.0.42 "GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76" status: 404 len: 111 microversion: 2.1 time: 0.032418 Jul 26 03:17:06.669515 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 401/778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:06 2022] GET /compute/v2.1/servers/c517b5ca-379c-4830-bc26-021ce1412c76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:07.725809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:07.726371 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:07.733711 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:07.734164 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:07.734937 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:07.735391 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:07.836364 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lazy-loading 'services' on Instance uuid cef280c7-6724-4574-9c5e-93236d7c63fa {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:17:07.939400 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bd2c6448-cacd-436a-9167-78f42bfbe1eb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa/os-volume_attachments/66a082dc-fd3e-4038-a1bb-a222fa1ad9ab" status: 202 len: 0 microversion: 2.1 time: 0.217518 Jul 26 03:17:07.940332 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 378/779] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:17:07 2022] DELETE /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa/os-volume_attachments/66a082dc-fd3e-4038-a1bb-a222fa1ad9ab => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:17:09.087416 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:09.087917 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:09.096457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:09.097118 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:09.098269 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:09.098907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:09.127288 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:17:09.219282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-975182a4-090e-40e7-8ede-1db5ce9cb4dd tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 204 len: 0 microversion: 2.1 time: 0.135509 Jul 26 03:17:09.220410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 402/780] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:17:09 2022] DELETE /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:17:09.230783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:09.231514 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:09.237973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:09.238432 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:09.239223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:09.239673 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:09.453396 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:09.465640 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5c8b21c7-6381-45a6-9f83-808f942af166 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1513 microversion: 2.1 time: 0.239854 Jul 26 03:17:09.466799 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 379/781] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:09 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:09.921952 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3fa8a8aa-a677-4894-b4b7-5d5032b5447b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:09.925095 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3fa8a8aa-a677-4894-b4b7-5d5032b5447b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:09.935801 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fa8a8aa-a677-4894-b4b7-5d5032b5447b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:09.936465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fa8a8aa-a677-4894-b4b7-5d5032b5447b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:09.937959 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fa8a8aa-a677-4894-b4b7-5d5032b5447b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:09.938540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3fa8a8aa-a677-4894-b4b7-5d5032b5447b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:09.969915 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:09.974918 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3fa8a8aa-a677-4894-b4b7-5d5032b5447b tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060185 Jul 26 03:17:09.975851 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 403/782] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Jul 26 03:17:09 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:10.080502 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:10.081152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:10.089785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:10.090708 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:10.092539 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:10.093200 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:10.126445 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:17:10.236782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7a26aafa-c6af-4479-881c-be3af58acaf5 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 204 len: 0 microversion: 2.20 time: 0.167741 Jul 26 03:17:10.246208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 380/783] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Jul 26 03:17:10 2022] DELETE /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 03:17:10.252048 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:10.252676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:10.272969 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:10.273525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:10.274313 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:10.275252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:10.464797 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:10.472993 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:10.474594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:10.475855 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8d46e434-385c-444e-bb0a-5fdeb355bab2 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.231775 Jul 26 03:17:10.476499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 404/784] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:17:10 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:17:10.489886 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:10.490911 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:10.497529 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:10.498229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:10.499086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:10.499534 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:10.692266 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:10.700147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-40974aaf-5b1d-4608-8df7-2186ef347116 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1513 microversion: 2.1 time: 0.215022 Jul 26 03:17:10.700707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 381/785] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:10 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:11.499462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:11.500051 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:11.506469 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:11.506909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:11.507855 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:11.508281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:11.648658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:11.663283 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:11.665038 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:11.666489 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3f83fa6b-aa4b-4b21-a891-9c0e6be00a2e tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.171003 Jul 26 03:17:11.667398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 405/786] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:17:11 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:17:11.722512 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:11.723457 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:11.730448 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:11.731089 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:11.732031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:11.732611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:11.871312 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:11.879513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0a6a7230-6fef-4a68-b96e-565853c5a7fb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1513 microversion: 2.1 time: 0.161725 Jul 26 03:17:11.880080 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 382/787] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:11 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:17:12.616957 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-c82cf984-361f-43e1-a56d-e8a2a3bf2b45 req-4b364453-86d1-4966-a843-5f90d97742be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef280c7-6724-4574-9c5e-93236d7c63fa", "name": "network-vif-deleted", "tag": "6424f09f-5b81-4a11-931e-dc12f6472a63"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:12.629026 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c82cf984-361f-43e1-a56d-e8a2a3bf2b45 req-4b364453-86d1-4966-a843-5f90d97742be service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:12.629463 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-c82cf984-361f-43e1-a56d-e8a2a3bf2b45 req-4b364453-86d1-4966-a843-5f90d97742be service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:12.642645 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-c82cf984-361f-43e1-a56d-e8a2a3bf2b45 req-4b364453-86d1-4966-a843-5f90d97742be service nova] Creating event network-vif-deleted:6424f09f-5b81-4a11-931e-dc12f6472a63 for instance cef280c7-6724-4574-9c5e-93236d7c63fa on hv-cinder-85084 Jul 26 03:17:12.647996 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-c82cf984-361f-43e1-a56d-e8a2a3bf2b45 req-4b364453-86d1-4966-a843-5f90d97742be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035084 Jul 26 03:17:12.648597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 406/788] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:12.690710 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:12.691500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:12.698527 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:12.698930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:12.699997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:12.700594 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:12.902558 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:12.903433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:12.910244 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:12.910798 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:12.911499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:12.912176 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:12.920793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:12.937162 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:12.939658 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '037c9f8229a44de198ebc3752f7a1966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab741435041940cc9c7f02b27120bd90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:12.941131 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5e99b340-cde7-481e-a713-e99d6683e035 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 200 len: 1723 microversion: 2.20 time: 0.255270 Jul 26 03:17:12.943010 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 383/789] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:17:12 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 03:17:12.948125 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:12.948624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:12.949048 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lazy-loading 'fault' on Instance uuid cef280c7-6724-4574-9c5e-93236d7c63fa {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:17:12.994184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:13.006164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-418c4ae0-bb10-48a5-9064-e204c0a23d79 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 200 len: 1308 microversion: 2.1 time: 0.108169 Jul 26 03:17:13.006749 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 407/790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:12 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:13.353159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-a0e3d7f9-61fb-427f-85ce-ecc4b6266396 req-30bd2c5d-6b98-448d-afbc-35c5e5387e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe0d48e-9b52-48e2-bf40-30f16f2fd37d", "name": "network-vif-deleted", "tag": "9bba44c6-edd4-430c-95db-d19a412c48e7"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:13.378014 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-a0e3d7f9-61fb-427f-85ce-ecc4b6266396 req-30bd2c5d-6b98-448d-afbc-35c5e5387e81 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:13.378444 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-a0e3d7f9-61fb-427f-85ce-ecc4b6266396 req-30bd2c5d-6b98-448d-afbc-35c5e5387e81 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:13.389724 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-a0e3d7f9-61fb-427f-85ce-ecc4b6266396 req-30bd2c5d-6b98-448d-afbc-35c5e5387e81 service nova] Creating event network-vif-deleted:9bba44c6-edd4-430c-95db-d19a412c48e7 for instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d on hv-cinder-85084 Jul 26 03:17:13.394541 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-a0e3d7f9-61fb-427f-85ce-ecc4b6266396 req-30bd2c5d-6b98-448d-afbc-35c5e5387e81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208864 Jul 26 03:17:13.395252 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 384/791] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:13.965838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:13.966466 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:13.973234 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:13.973546 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:13.974346 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:13.974784 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:13.990802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] HTTP exception thrown: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Request method failure captured: Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d HTTP/1.1 Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31s2DJLaZkwVrDL_3gJg-gcmuBCKukBMvBU-rJVlUt4aOTILRHcZ2en__so-5zFgBkFovtQM9uF2wcPUaudzE8N67CN25k3WjRGZ2RjZ2CMupAF8aMpquD0MfYN1f7lYJ_LJwx44omwbM-L6JbLieuXvES8wSLQMQV8avIszasAWfXY Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:13.992525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 037c9f8229a44de198ebc3752f7a1966 Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:13.993876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'dbe0d48e-9b52-48e2-bf40-30f16f2fd37d'} Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:13.994584 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:13.995900 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:13.997332 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Returning 404 to user: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:13.997332 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-94552c66-1237-4c87-93fe-bcd55dc572ce tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 404 len: 111 microversion: 2.20 time: 0.032143 Jul 26 03:17:13.998225 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 408/792] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:17:13 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:17:14.004053 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-37aae5b7-5873-4dd7-9055-5b2a996a28b1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '.version_select at 0x7f5f7947b280>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:14.027342 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-37aae5b7-5873-4dd7-9055-5b2a996a28b1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380810819" status: 204 len: 0 microversion: 2.20 time: 0.027417 Jul 26 03:17:14.028163 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 385/793] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Jul 26 03:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380810819 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 03:17:14.029854 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:14.030455 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: cef280c7-6724-4574-9c5e-93236d7c63fa] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:14.037155 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:14.037827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:14.038738 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:14.039302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:14.054024 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] HTTP exception thrown: Instance cef280c7-6724-4574-9c5e-93236d7c63fa could not be found. Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Request method failure captured: Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa HTTP/1.1 Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31x9dEZ2Be3P6C9BhZ8_Fo3TAXcJCpRKagYaVP7_CzUmq4VlUlnzCFYV9-IgTfdgMiPvHiF98MZB9jCWm9Bch0mRME7KXWOWa0TblIDnfNM-obTjkS9EstogMuGS-iFlpUKRff9hHTzHHbw51MhFhDOnK5KYwiSwvROU0OjvWDzgukE Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: 8bd77269b8504984b3e086be66ac9713 Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1928390846 Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:14.055943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8bd77269b8504984b3e086be66ac9713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8bd77269b8504984b3e086be66ac9713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8bd77269b8504984b3e086be66ac9713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8bd77269b8504984b3e086be66ac9713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesSnapshotTestJSON-1928390846 Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: 8bd77269b8504984b3e086be66ac9713 Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1928390846 Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesSnapshotTestJSON-1928390846-project Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: c70c080fc8354ccf90391984baf6052f Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesSnapshotTestJSON-1928390846-project Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance cef280c7-6724-4574-9c5e-93236d7c63fa could not be found. Jul 26 03:17:14.057342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'cef280c7-6724-4574-9c5e-93236d7c63fa'} Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef280c7-6724-4574-9c5e-93236d7c63fa could not be found. Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:14.062020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef280c7-6724-4574-9c5e-93236d7c63fa could not be found. Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef280c7-6724-4574-9c5e-93236d7c63fa could not be found. Jul 26 03:17:14.063221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:14.064252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Returning 404 to user: Instance cef280c7-6724-4574-9c5e-93236d7c63fa could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:14.064252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6ea5341d-22ad-4d5c-95be-92ec6a58ae18 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa" status: 404 len: 111 microversion: 2.1 time: 0.031329 Jul 26 03:17:14.064252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 409/794] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:14 2022] GET /compute/v2.1/servers/cef280c7-6724-4574-9c5e-93236d7c63fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:21.173582 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:21.174201 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:21.181257 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:21.181696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:21.182458 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:21.182893 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:21.196764 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] HTTP exception thrown: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Request method failure captured: Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d HTTP/1.1 Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31s2DJLaZkwVrDL_3gJg-gcmuBCKukBMvBU-rJVlUt4aOTILRHcZ2en__so-5zFgBkFovtQM9uF2wcPUaudzE8N67CN25k3WjRGZ2RjZ2CMupAF8aMpquD0MfYN1f7lYJ_LJwx44omwbM-L6JbLieuXvES8wSLQMQV8avIszasAWfXY Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:17:21.198473 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 037c9f8229a44de198ebc3752f7a1966 Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.200153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'dbe0d48e-9b52-48e2-bf40-30f16f2fd37d'} Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:21.200931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.202317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.203572 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Returning 404 to user: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:21.203572 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-2cf6e232-c5f7-48ab-9a51-0130ff0383c1 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 404 len: 111 microversion: 2.20 time: 0.030248 Jul 26 03:17:21.203572 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 386/795] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Jul 26 03:17:21 2022] DELETE /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:17:21.208320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:21.208913 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: dbe0d48e-9b52-48e2-bf40-30f16f2fd37d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:21.215690 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:21.216129 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:21.216873 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:21.217298 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:21.230989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] HTTP exception thrown: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Request method failure captured: Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d HTTP/1.1 Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31s2DJLaZkwVrDL_3gJg-gcmuBCKukBMvBU-rJVlUt4aOTILRHcZ2en__so-5zFgBkFovtQM9uF2wcPUaudzE8N67CN25k3WjRGZ2RjZ2CMupAF8aMpquD0MfYN1f7lYJ_LJwx44omwbM-L6JbLieuXvES8wSLQMQV8avIszasAWfXY Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:21.232537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 037c9f8229a44de198ebc3752f7a1966 Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.234164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'dbe0d48e-9b52-48e2-bf40-30f16f2fd37d'} Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:21.235074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. Jul 26 03:17:21.236624 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:21.237924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Returning 404 to user: Instance dbe0d48e-9b52-48e2-bf40-30f16f2fd37d could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:21.237924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2e9e856e-fe95-46b3-8c58-8c62a2b9fc70 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d" status: 404 len: 111 microversion: 2.20 time: 0.029448 Jul 26 03:17:21.237924 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 410/796] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:17:21 2022] GET /compute/v2.1/servers/dbe0d48e-9b52-48e2-bf40-30f16f2fd37d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:17:24.117426 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1279898078", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "networks": [{"uuid": "95714943-b739-4cc7-951c-93ef6a13b1fa"}]}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:24.176256 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] validate_networks() for [('95714943-b739-4cc7-951c-93ef6a13b1fa', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:17:24.502114 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:24.503501 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:24.507883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:24.512940 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:24.513728 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:24.514504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:24.515148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:24.538516 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] HTTP exception thrown: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Request method failure captured: Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 HTTP/1.1 Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31s2DJLaZkwVrDL_3gJg-gcmuBCKukBMvBU-rJVlUt4aOTILRHcZ2en__so-5zFgBkFovtQM9uF2wcPUaudzE8N67CN25k3WjRGZ2RjZ2CMupAF8aMpquD0MfYN1f7lYJ_LJwx44omwbM-L6JbLieuXvES8wSLQMQV8avIszasAWfXY Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:24.540328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 037c9f8229a44de198ebc3752f7a1966 Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.541646 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '634ce020-f329-4f42-aca0-d419ac3ba613'} Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:24.542460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.544450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.547228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Returning 404 to user: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:24.547228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d29d37bc-8cb5-4ccc-b32e-7317f25441b9 tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "DELETE /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 404 len: 111 microversion: 2.20 time: 0.044842 Jul 26 03:17:24.547228 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 411/797] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Jul 26 03:17:24 2022] DELETE /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 03:17:24.551201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:24.551950 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] [instance: 634ce020-f329-4f42-aca0-d419ac3ba613] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:24.558308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:24.558917 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:24.560066 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:24.560807 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:24.575165 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] HTTP exception thrown: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Request method failure captured: Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 HTTP/1.1 Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31s2DJLaZkwVrDL_3gJg-gcmuBCKukBMvBU-rJVlUt4aOTILRHcZ2en__so-5zFgBkFovtQM9uF2wcPUaudzE8N67CN25k3WjRGZ2RjZ2CMupAF8aMpquD0MfYN1f7lYJ_LJwx44omwbM-L6JbLieuXvES8wSLQMQV8avIszasAWfXY Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:24.576704 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ab741435041940cc9c7f02b27120bd90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: ab741435041940cc9c7f02b27120bd90 Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-735688827 Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 037c9f8229a44de198ebc3752f7a1966 Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-AttachVolumeShelveTestJSON-735688827-project Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '634ce020-f329-4f42-aca0-d419ac3ba613'} Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:24.578901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. Jul 26 03:17:24.580135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:24.581164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] Returning 404 to user: Instance 634ce020-f329-4f42-aca0-d419ac3ba613 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:24.581164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7ddb4517-f4ef-4bbf-9fd0-8ff34700cafd tempest-AttachVolumeShelveTestJSON-735688827 tempest-AttachVolumeShelveTestJSON-735688827-project] 10.222.0.42 "GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613" status: 404 len: 111 microversion: 2.20 time: 0.031465 Jul 26 03:17:24.581164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 412/798] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 26 03:17:24 2022] GET /compute/v2.1/servers/634ce020-f329-4f42-aca0-d419ac3ba613 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 03:17:24.587408 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:17:24.587972 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:17:24.588470 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:17:24.588869 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:17:24.589270 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:17:24.599831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:24.600043 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:24.601432 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:24.601432 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:24.620808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Getting quotas for project 8bd77269b8504984b3e086be66ac9713. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:17:24.625529 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Getting quotas for user c70c080fc8354ccf90391984baf6052f and project 8bd77269b8504984b3e086be66ac9713. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:17:24.639067 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:17:24.641723 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:17:24.701322 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-82aaff3d-5ed6-40b8-a8ee-ca94f46f927d tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587433 Jul 26 03:17:24.702677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 387/799] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:17:24.715630 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-896a9a3c-ded2-4ee8-b0df-a9704f9ad68f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:24.716242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-896a9a3c-ded2-4ee8-b0df-a9704f9ad68f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:24.780653 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-896a9a3c-ded2-4ee8-b0df-a9704f9ad68f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:24.788509 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-896a9a3c-ded2-4ee8-b0df-a9704f9ad68f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1219 microversion: 2.1 time: 0.076573 Jul 26 03:17:24.789339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 413/800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:24 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:25.811278 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:25.812579 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:25.815869 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:25.827823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:25.831247 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:25.835226 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:25.836974 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:25.978158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:25.987116 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f7bfa68c-ba9c-4548-a7c9-d021fd93e5e1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1289 microversion: 2.1 time: 0.180972 Jul 26 03:17:25.988389 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 388/801] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:25 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1289 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:27.013615 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:27.013615 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:27.016564 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:27.016966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:27.017715 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:27.018135 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:27.584721 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:27.592654 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c9effd54-5d0d-4fa8-9f26-6603a34e81f2 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.587253 Jul 26 03:17:27.593231 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 414/802] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:27 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:27.857173 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-34aedbe4-6bbd-4985-bdff-5f0bad2be0b3 req-4c23f57a-c032-46da-be24-4b6a500401c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7865fb-14d2-413c-9f34-7402d70e4308", "tag": "da24c78e-34a6-4221-98bb-d4574e9d6954"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:27.885399 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-34aedbe4-6bbd-4985-bdff-5f0bad2be0b3 req-4c23f57a-c032-46da-be24-4b6a500401c4 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:27.885842 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-34aedbe4-6bbd-4985-bdff-5f0bad2be0b3 req-4c23f57a-c032-46da-be24-4b6a500401c4 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:27.909907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-34aedbe4-6bbd-4985-bdff-5f0bad2be0b3 req-4c23f57a-c032-46da-be24-4b6a500401c4 service nova] Creating event network-changed:da24c78e-34a6-4221-98bb-d4574e9d6954 for instance 8b7865fb-14d2-413c-9f34-7402d70e4308 on hv-cinder-85084 Jul 26 03:17:27.915560 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-34aedbe4-6bbd-4985-bdff-5f0bad2be0b3 req-4c23f57a-c032-46da-be24-4b6a500401c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062128 Jul 26 03:17:27.916184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 389/803] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:28.615156 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:28.615963 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:28.629812 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:28.630411 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:28.633714 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:28.637947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:28.827915 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:28.836700 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8fcfc51b-67f6-4f7c-83c8-3159f2c3f978 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.226749 Jul 26 03:17:28.838374 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 415/804] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:28 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:29.866673 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:29.867546 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:29.875476 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:29.876050 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:29.877027 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:29.877468 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:30.030816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-139b8824-cbb1-40aa-a68d-411f5323144f tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Action: 'create', calling method: .version_select at 0x7f5f7df2c430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1328840415"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:30.035603 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:30.052466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f3fcde76-25ab-4f30-85ad-647648a1482c tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.197464 Jul 26 03:17:30.053096 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 390/805] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:29 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:30.420743 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-139b8824-cbb1-40aa-a68d-411f5323144f tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.545788 Jul 26 03:17:30.421705 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 416/806] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Jul 26 03:17:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 547 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 03:17:30.435189 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-50fa047f-527f-4e2a-861a-dbd0aff4ee54 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f794844c0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:30.504330 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-50fa047f-527f-4e2a-861a-dbd0aff4ee54 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3" status: 200 len: 345 microversion: 2.1 time: 0.073706 Jul 26 03:17:30.505123 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 391/807] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:17:30 2022] GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:17:31.076975 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:31.077559 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:31.084612 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:31.085058 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:31.085799 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:31.086235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:31.215695 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:31.223298 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-77eca57d-d6fb-4049-9c78-cfd43499633a tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.150695 Jul 26 03:17:31.223860 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 417/808] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:31 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:31.518130 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d1fde23b-746e-49a6-97ee-f9e274d0b44a tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f794701f0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:31.572782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d1fde23b-746e-49a6-97ee-f9e274d0b44a tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3" status: 200 len: 346 microversion: 2.1 time: 0.058891 Jul 26 03:17:31.573478 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 392/809] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:17:31 2022] GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:31.588541 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-915cd52e-b9d2-4a9e-a10f-e729d1852f9c tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Action: 'create', calling method: .version_select at 0x7f5f7df2cd30>, body: {"snapshot": {"volume_id": "5357044f-1353-4609-a372-3f46adf60be3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1229975801"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:31.798314 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-915cd52e-b9d2-4a9e-a10f-e729d1852f9c tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.215451 Jul 26 03:17:31.799417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 418/810] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Jul 26 03:17:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:31.811813 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e2defb69-aea0-44ca-8009-989ac0077373 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f79470ca0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:31.855672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e2defb69-aea0-44ca-8009-989ac0077373 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 200 len: 287 microversion: 2.1 time: 0.048972 Jul 26 03:17:31.856235 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 393/811] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Jul 26 03:17:31 2022] GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:31.871990 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8703adfe-2634-4ff6-8db7-8d5274704e0c tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f7df324c0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:31.909398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8703adfe-2634-4ff6-8db7-8d5274704e0c tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044731 Jul 26 03:17:31.909615 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 419/812] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Jul 26 03:17:31 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:31.920784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b6576190-4f17-4a2a-944e-de07fa219ba6 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f79470c10>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:31.951926 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b6576190-4f17-4a2a-944e-de07fa219ba6 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 200 len: 287 microversion: 2.1 time: 0.035140 Jul 26 03:17:31.952610 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 394/813] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Jul 26 03:17:31 2022] GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:32.245800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:32.246444 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:32.252893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:32.253381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:32.254208 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:32.254681 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:32.394651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:32.402392 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3b8ff6d6-eeb2-4a7a-83c0-2376458ae4b5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.161705 Jul 26 03:17:32.403071 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 420/814] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:32 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:32.964539 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a6308af8-b6a0-47b9-bd5d-e824b7487e28 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f79484a60>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:32.994134 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a6308af8-b6a0-47b9-bd5d-e824b7487e28 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 200 len: 287 microversion: 2.1 time: 0.033782 Jul 26 03:17:32.994697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 395/815] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Jul 26 03:17:32 2022] GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:33.425261 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:33.426133 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:33.436344 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:33.437009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:33.438193 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:33.438843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:33.571500 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:33.579521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bfc92b32-eaca-4595-8043-0c8a6bbc8c07 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.159602 Jul 26 03:17:33.580079 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 421/816] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:33 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:34.006991 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-516e02f8-6ab5-417a-8882-6c5ec704565c tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f7948e3a0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:34.039749 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-516e02f8-6ab5-417a-8882-6c5ec704565c tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 200 len: 287 microversion: 2.1 time: 0.036971 Jul 26 03:17:34.040324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 396/817] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Jul 26 03:17:34 2022] GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:34.605962 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:34.606772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:34.618009 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:34.618757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:34.620058 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:34.620781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:34.755921 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:34.765612 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7bb9304d-efc6-4745-8330-821cfc452079 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.166315 Jul 26 03:17:34.766181 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 422/818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:34 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:35.049688 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:35.050616 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=6 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:35.055382 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-8f4240b5-84d0-418c-822f-db9b052c4bb9 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f79470ee0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:35.092598 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-8f4240b5-84d0-418c-822f-db9b052c4bb9 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 200 len: 288 microversion: 2.1 time: 0.043613 Jul 26 03:17:35.093260 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 397/819] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Jul 26 03:17:35 2022] GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 288 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:17:35.105787 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8f81a438-5ed9-40b4-af83-f7b9f09fa46a tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f7df0b040>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:35.112783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:35.177173 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8f81a438-5ed9-40b4-af83-f7b9f09fa46a tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 202 len: 0 microversion: 2.1 time: 0.075809 Jul 26 03:17:35.177748 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 423/820] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Jul 26 03:17:35 2022] DELETE /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:17:35.186568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3990558f-841f-4c7c-af05-735a45795095 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f794703a0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:35.216300 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3990558f-841f-4c7c-af05-735a45795095 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 200 len: 287 microversion: 2.1 time: 0.033481 Jul 26 03:17:35.217068 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 398/821] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Jul 26 03:17:35 2022] GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:17:35.787406 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:35.787951 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:35.794492 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:35.794939 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:35.795727 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:35.796156 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:35.929537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:35.937429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fa05bf77-4e92-4a21-962b-1fcbb3e5c204 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.154443 Jul 26 03:17:35.937927 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 424/822] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:35 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:36.230484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-071d10eb-28f4-4d6f-b3be-77e62eb21c3b tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f7948edc0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:36.260342 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-071d10eb-28f4-4d6f-b3be-77e62eb21c3b tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] HTTP exception thrown: Snapshot 8862360e-0b27-4cd6-9e11-d5ac22c97a1b could not be found. Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-071d10eb-28f4-4d6f-b3be-77e62eb21c3b tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Request method failure captured: Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b HTTP/1.1 Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31zJcKEG36POaSboCazDNs5jSFp7skl3HaYZktSbQfk8sMf-bj19hhRpk2ECmd8sT21zwgN0r42ft_ZZzOR1sgzjw2kJai3se5LGjKkMNA0bCII05ZrzXEv6ITZr7wk-TTmZ7saIkx0azsZRrL5Krz1JD4_-3p6bc8rqh-bC1MAxj5U Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:17:36.262661 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 740edf2471e14961bab709844ebd876d Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Snapshot 8862360e-0b27-4cd6-9e11-d5ac22c97a1b could not be found. Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '8862360e-0b27-4cd6-9e11-d5ac22c97a1b'} Jul 26 03:17:36.264339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8862360e-0b27-4cd6-9e11-d5ac22c97a1b could not be found. (HTTP 404) (Request-ID: req-5c134c2d-2f30-46a1-9c11-3ace0c4f3a27) Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:36.265323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:17:36.268119 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8862360e-0b27-4cd6-9e11-d5ac22c97a1b could not be found. Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 03:17:36.269607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8862360e-0b27-4cd6-9e11-d5ac22c97a1b could not be found. Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8862360e-0b27-4cd6-9e11-d5ac22c97a1b could not be found. Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-071d10eb-28f4-4d6f-b3be-77e62eb21c3b tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Returning 404 to user: Snapshot 8862360e-0b27-4cd6-9e11-d5ac22c97a1b could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:36.271466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-071d10eb-28f4-4d6f-b3be-77e62eb21c3b tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b" status: 404 len: 111 microversion: 2.1 time: 0.038903 Jul 26 03:17:36.273098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 399/823] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Jul 26 03:17:36 2022] GET /compute/v2.1/os-snapshots/8862360e-0b27-4cd6-9e11-d5ac22c97a1b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:36.273827 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-956ce06c-1c06-4bf6-8e76-ca3449c6e7d0 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f7df0b790>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:36.341697 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-956ce06c-1c06-4bf6-8e76-ca3449c6e7d0 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3" status: 202 len: 0 microversion: 2.1 time: 0.072429 Jul 26 03:17:36.342255 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 425/824] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:17:36 2022] DELETE /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:17:36.350504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-91c552f1-ccfc-4294-be47-59067a78dd7f tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f79504820>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:36.398550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-91c552f1-ccfc-4294-be47-59067a78dd7f tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3" status: 200 len: 345 microversion: 2.1 time: 0.051723 Jul 26 03:17:36.399172 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 400/825] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:17:36 2022] GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:36.959450 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:36.959991 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:36.967039 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:36.967513 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:36.968288 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:36.968734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:36.983432 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-78ed073e-e7c7-4828-9123-2298d35acaca req-23e134df-461a-4349-9099-bb668e9a5020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7865fb-14d2-413c-9f34-7402d70e4308", "name": "network-vif-plugged", "status": "completed", "tag": "da24c78e-34a6-4221-98bb-d4574e9d6954"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:36.996414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-78ed073e-e7c7-4828-9123-2298d35acaca req-23e134df-461a-4349-9099-bb668e9a5020 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:36.997171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-78ed073e-e7c7-4828-9123-2298d35acaca req-23e134df-461a-4349-9099-bb668e9a5020 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:37.000478 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:37.010683 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-78ed073e-e7c7-4828-9123-2298d35acaca req-23e134df-461a-4349-9099-bb668e9a5020 service nova] Creating event network-vif-plugged:da24c78e-34a6-4221-98bb-d4574e9d6954 for instance 8b7865fb-14d2-413c-9f34-7402d70e4308 on hv-cinder-85084 Jul 26 03:17:37.016254 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-78ed073e-e7c7-4828-9123-2298d35acaca req-23e134df-461a-4349-9099-bb668e9a5020 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036969 Jul 26 03:17:37.018383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 401/826] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:37.104252 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:37.112910 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-ce1e1997-afd7-4f56-83f2-15205b4a0df5 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.157933 Jul 26 03:17:37.113919 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 426/827] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:36 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:37.417671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-da6dfdd5-0841-498e-a3d7-10e657110701 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f7948e430>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:37.455469 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-da6dfdd5-0841-498e-a3d7-10e657110701 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] HTTP exception thrown: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-da6dfdd5-0841-498e-a3d7-10e657110701 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Request method failure captured: Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 HTTP/1.1 Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31zJcKEG36POaSboCazDNs5jSFp7skl3HaYZktSbQfk8sMf-bj19hhRpk2ECmd8sT21zwgN0r42ft_ZZzOR1sgzjw2kJai3se5LGjKkMNA0bCII05ZrzXEv6ITZr7wk-TTmZ7saIkx0azsZRrL5Krz1JD4_-3p6bc8rqh-bC1MAxj5U Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:17:37.457815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 740edf2471e14961bab709844ebd876d Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '5357044f-1353-4609-a372-3f46adf60be3'} Jul 26 03:17:37.459554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. (HTTP 404) (Request-ID: req-c56a0d7f-79c7-4d15-bb9f-81bb1f766bd6) Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.460866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:17:37.462229 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 03:17:37.463586 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-da6dfdd5-0841-498e-a3d7-10e657110701 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Returning 404 to user: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-da6dfdd5-0841-498e-a3d7-10e657110701 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3" status: 404 len: 109 microversion: 2.1 time: 0.048914 Jul 26 03:17:37.465098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 402/828] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:17:37 2022] GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:37.476241 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-015eb175-8212-4877-bbed-5a86f652e925 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f7df0b550>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:37.512589 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-015eb175-8212-4877-bbed-5a86f652e925 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] HTTP exception thrown: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-015eb175-8212-4877-bbed-5a86f652e925 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Request method failure captured: Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: DELETE /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 HTTP/1.1 Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31zJcKEG36POaSboCazDNs5jSFp7skl3HaYZktSbQfk8sMf-bj19hhRpk2ECmd8sT21zwgN0r42ft_ZZzOR1sgzjw2kJai3se5LGjKkMNA0bCII05ZrzXEv6ITZr7wk-TTmZ7saIkx0azsZRrL5Krz1JD4_-3p6bc8rqh-bC1MAxj5U Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:17:37.514942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 740edf2471e14961bab709844ebd876d Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '5357044f-1353-4609-a372-3f46adf60be3'} Jul 26 03:17:37.516578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. (HTTP 404) (Request-ID: req-65125e13-173b-419e-94bc-43cb27c10cab) Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.517578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 03:17:37.519022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 03:17:37.520342 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-015eb175-8212-4877-bbed-5a86f652e925 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Returning 404 to user: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-015eb175-8212-4877-bbed-5a86f652e925 tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3" status: 404 len: 109 microversion: 2.1 time: 0.044234 Jul 26 03:17:37.521679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 427/829] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Jul 26 03:17:37 2022] DELETE /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:37.530862 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e85219e1-daf4-4452-84b2-63f471678b3e tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Calling method '.version_select at 0x7f5f794703a0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:37.560743 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-e85219e1-daf4-4452-84b2-63f471678b3e tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] HTTP exception thrown: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e85219e1-daf4-4452-84b2-63f471678b3e tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Request method failure captured: Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 HTTP/1.1 Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31zJcKEG36POaSboCazDNs5jSFp7skl3HaYZktSbQfk8sMf-bj19hhRpk2ECmd8sT21zwgN0r42ft_ZZzOR1sgzjw2kJai3se5LGjKkMNA0bCII05ZrzXEv6ITZr7wk-TTmZ7saIkx0azsZRrL5Krz1JD4_-3p6bc8rqh-bC1MAxj5U Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:17:37.562675 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6b0117c65a04365a08daf58e03470dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: e6b0117c65a04365a08daf58e03470dc Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2138309132 Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 740edf2471e14961bab709844ebd876d Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2138309132-project Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '5357044f-1353-4609-a372-3f46adf60be3'} Jul 26 03:17:37.564500 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. (HTTP 404) (Request-ID: req-a87b255b-90f2-4b75-af20-56fa1a995e61) Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.565495 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 03:17:37.567065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 03:17:37.568793 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e85219e1-daf4-4452-84b2-63f471678b3e tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] Returning 404 to user: Volume 5357044f-1353-4609-a372-3f46adf60be3 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e85219e1-daf4-4452-84b2-63f471678b3e tempest-VolumesSnapshotsTestJSON-2138309132 tempest-VolumesSnapshotsTestJSON-2138309132-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3" status: 404 len: 109 microversion: 2.1 time: 0.037127 Jul 26 03:17:37.570171 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 403/830] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Jul 26 03:17:37 2022] GET /compute/v2.1/os-volumes/5357044f-1353-4609-a372-3f46adf60be3 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:17:38.134590 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:38.136170 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:38.142245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:38.142694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:38.143475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:38.143908 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:38.297449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:38.305316 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e56b9a19-0420-4546-8441-e8146daf9111 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1319 microversion: 2.1 time: 0.175279 Jul 26 03:17:38.305902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 428/831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:38 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:39.326669 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:39.328147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:39.340837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:39.341288 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:39.342085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:39.342545 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:39.487358 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:39.496062 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4db9913a-2efa-4d79-895e-8f8995d3eef6 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1509 microversion: 2.1 time: 0.173411 Jul 26 03:17:39.510975 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 404/832] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:39 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:39.519398 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4d46629e-c88b-4aa3-aac2-30fe2c75e65f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63504275-bf40-403e-ae70-4cd6eb7e9056", "device": "/dev/sdb"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:39.522341 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4d46629e-c88b-4aa3-aac2-30fe2c75e65f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:39.528885 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d46629e-c88b-4aa3-aac2-30fe2c75e65f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:39.529391 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d46629e-c88b-4aa3-aac2-30fe2c75e65f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:39.530210 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d46629e-c88b-4aa3-aac2-30fe2c75e65f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:39.530695 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d46629e-c88b-4aa3-aac2-30fe2c75e65f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:39.810563 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:39.823104 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4d46629e-c88b-4aa3-aac2-30fe2c75e65f tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "POST /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307795 Jul 26 03:17:39.830013 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 429/833] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:17:39 2022] POST /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:53.649033 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-655470148", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "networks": [{"uuid": "2752ed4d-6948-4f25-a6ac-a31ddb1b8ff3"}]}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:53.658086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=9 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:53.658754 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=7 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:53.706801 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] validate_networks() for [('2752ed4d-6948-4f25-a6ac-a31ddb1b8ff3', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:17:54.120309 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:17:54.120727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:17:54.121191 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:17:54.121596 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:17:54.122036 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:17:54.132027 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:54.132475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:54.133292 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:54.133697 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:54.156373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Getting quotas for project ad3b89efcbc94f19a867fe700046b0f2. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:17:54.160721 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Getting quotas for user 72614ab651224f4b9c0f2fb90806aadf and project ad3b89efcbc94f19a867fe700046b0f2. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:17:54.171902 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:17:54.174156 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:17:54.225875 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-3196f0f2-3e16-4c9b-b7a0-eaa2392a81b7 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580451 Jul 26 03:17:54.227087 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 405/834] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:17:54.242732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=27 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:17:54.247222 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-94624a11-66a6-41d0-ba28-2a9ef4325873 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:54.247966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-94624a11-66a6-41d0-ba28-2a9ef4325873 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:54.323360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-94624a11-66a6-41d0-ba28-2a9ef4325873 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:54.331290 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-94624a11-66a6-41d0-ba28-2a9ef4325873 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1213 microversion: 2.1 time: 0.090863 Jul 26 03:17:54.331871 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 430/835] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:54 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:55.352687 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:55.353334 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:55.360391 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:55.360840 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:55.361604 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:55.362071 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:55.426468 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:55.434259 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d38800d8-fa6b-488a-8d39-52f9327c3d07 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1217 microversion: 2.1 time: 0.085924 Jul 26 03:17:55.434833 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 406/836] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:55 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:56.460144 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:56.461136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:56.472688 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:56.473415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:56.475040 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:56.475767 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:56.539539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:56.549082 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4b19e84f-57ec-4937-8d62-8ca1e325b793 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1209 microversion: 2.1 time: 0.094734 Jul 26 03:17:56.549082 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 431/837] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:56 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:57.568812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:57.569444 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:57.576568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:57.577028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:57.577781 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:57.578201 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:57.680336 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:57.688645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-275acd0e-b896-4a6f-894d-53e4b6edd98d tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1271 microversion: 2.1 time: 0.123703 Jul 26 03:17:57.689257 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 407/838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:57 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:58.690978 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-e8e54086-4f51-4fb8-a718-19c879725223 req-91f9facd-8d67-48dc-970b-992269e256d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63377566-399d-4621-a5e6-f027c80757cc", "tag": "25f60663-5598-468a-a8a5-3452cc7a77cc"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:17:58.701278 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e8e54086-4f51-4fb8-a718-19c879725223 req-91f9facd-8d67-48dc-970b-992269e256d6 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:58.701693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-e8e54086-4f51-4fb8-a718-19c879725223 req-91f9facd-8d67-48dc-970b-992269e256d6 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:58.709833 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:58.710443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:58.713007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-e8e54086-4f51-4fb8-a718-19c879725223 req-91f9facd-8d67-48dc-970b-992269e256d6 service nova] Creating event network-changed:25f60663-5598-468a-a8a5-3452cc7a77cc for instance 63377566-399d-4621-a5e6-f027c80757cc on hv-cinder-85084 Jul 26 03:17:58.718070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:58.718284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-e8e54086-4f51-4fb8-a718-19c879725223 req-91f9facd-8d67-48dc-970b-992269e256d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030811 Jul 26 03:17:58.718477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:58.718657 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 432/839] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:17:58.719294 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:58.719701 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:58.852568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:17:58.860383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fbfd987b-fe92-4c3d-81cc-34fb011ca27f tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.154592 Jul 26 03:17:58.860962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 408/840] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:58 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:17:59.883607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:17:59.884320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:17:59.891298 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:59.891750 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:17:59.892505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:17:59.892934 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:00.024709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:00.032652 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bff6135b-f393-4f59-bfef-34a00c959ba3 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.154668 Jul 26 03:18:00.033195 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 433/841] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:17:59 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:01.053060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:01.053676 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:01.060714 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:01.061167 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:01.061943 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:01.062381 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:01.467727 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:01.476321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c6dd6e90-1d6d-4bae-895b-ea3f5cd92ec2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.427170 Jul 26 03:18:01.476990 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 409/842] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:01 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:02.084344 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:02.084920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:02.088159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-fc58a6cc-fff6-4999-a862-a94af4e438e4 req-d1856ec7-efbc-4965-8f0d-588b88d13c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c126b57-79ad-4bd0-9f2a-db16536258e3", "tag": "62b3e7a3-0978-4f57-a2ab-7e3928be96f1"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:02.091858 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.092282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.093103 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.093531 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.099334 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-fc58a6cc-fff6-4999-a862-a94af4e438e4 req-d1856ec7-efbc-4965-8f0d-588b88d13c94 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.099880 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-fc58a6cc-fff6-4999-a862-a94af4e438e4 req-d1856ec7-efbc-4965-8f0d-588b88d13c94 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.113339 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-fc58a6cc-fff6-4999-a862-a94af4e438e4 req-d1856ec7-efbc-4965-8f0d-588b88d13c94 service nova] Creating event network-changed:62b3e7a3-0978-4f57-a2ab-7e3928be96f1 for instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 on hv-cinder-85084 Jul 26 03:18:02.118962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-fc58a6cc-fff6-4999-a862-a94af4e438e4 req-d1856ec7-efbc-4965-8f0d-588b88d13c94 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034584 Jul 26 03:18:02.119851 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 410/843] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:18:02.123649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:18:02.206569 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0151df1b-e49b-4961-9fe3-0701a9a157fc tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 204 len: 0 microversion: 2.1 time: 0.125844 Jul 26 03:18:02.210454 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 434/844] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:18:02 2022] DELETE /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:18:02.216464 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:02.217155 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:02.223704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.224152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.224930 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.225363 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.368436 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:02.381994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b2b8add6-a4e6-4111-a8d6-39e358e9d686 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.164457 Jul 26 03:18:02.381994 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 411/845] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:02 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:02.498563 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:02.499303 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:02.505592 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.506070 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.506920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.507465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.643795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:02.652724 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9c169f72-5596-4177-97eb-58203f947827 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.158478 Jul 26 03:18:02.653663 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 435/846] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:02 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:02.816502 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:02.817304 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:02.825933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.825933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.825933 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:02.826550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:02.919415 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lazy-loading 'services' on Instance uuid 8b7865fb-14d2-413c-9f34-7402d70e4308 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:18:02.994896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-63728e0d-6f39-49f3-8926-14883d5c8fdf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308/os-volume_attachments/63504275-bf40-403e-ae70-4cd6eb7e9056" status: 202 len: 0 microversion: 2.1 time: 0.184606 Jul 26 03:18:02.996069 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 412/847] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:18:02 2022] DELETE /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308/os-volume_attachments/63504275-bf40-403e-ae70-4cd6eb7e9056 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:18:03.398007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:03.398588 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:03.405385 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:03.405832 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:03.406583 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:03.407039 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:03.570983 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:03.581108 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0159a06a-723e-4678-9419-72d5f3666e71 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.187022 Jul 26 03:18:03.581694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 436/848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:03 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:03.674826 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:03.675602 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:03.682073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:03.682784 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:03.683619 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:03.684097 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:03.875008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:03.882968 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1c9c2aa8-32b1-406d-9170-7bb8035ba621 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.212804 Jul 26 03:18:03.883559 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 413/849] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:03 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:04.602692 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:04.603448 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:04.606213 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:04.612274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:04.612709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:04.613729 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:04.614149 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:04.841565 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:04.851990 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f58e1c6d-fc0b-4755-bf58-5782be51482d tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1570 microversion: 2.1 time: 0.253006 Jul 26 03:18:04.852457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 437/850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:04 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1570 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:04.909140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:04.909730 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:04.919965 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:04.921248 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=6 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:04.922979 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:04.923456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:04.924219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:04.924613 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.135410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-dec8d9d2-6703-4d94-a2d8-37113cab879e req-5daac567-ad85-4e06-aa59-db8b9d18a56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c126b57-79ad-4bd0-9f2a-db16536258e3", "name": "network-vif-deleted", "tag": "62b3e7a3-0978-4f57-a2ab-7e3928be96f1"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:05.155047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-dec8d9d2-6703-4d94-a2d8-37113cab879e req-5daac567-ad85-4e06-aa59-db8b9d18a56a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:05.155485 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-dec8d9d2-6703-4d94-a2d8-37113cab879e req-5daac567-ad85-4e06-aa59-db8b9d18a56a service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.177642 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-dec8d9d2-6703-4d94-a2d8-37113cab879e req-5daac567-ad85-4e06-aa59-db8b9d18a56a service nova] Creating event network-vif-deleted:62b3e7a3-0978-4f57-a2ab-7e3928be96f1 for instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 on hv-cinder-85084 Jul 26 03:18:05.189853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-dec8d9d2-6703-4d94-a2d8-37113cab879e req-5daac567-ad85-4e06-aa59-db8b9d18a56a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057202 Jul 26 03:18:05.192159 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 438/851] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:18:05.218755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:05.219535 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:05.228428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:05.229293 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.230265 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:05.231169 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.266296 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:18:05.328159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:05.336147 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1dc3bb94-2021-409a-90df-774b84fb7566 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.430839 Jul 26 03:18:05.348672 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 414/852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:04 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:05.385208 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-be5a0794-5bf9-4cf6-95a3-79e3d85f16cf tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 204 len: 0 microversion: 2.1 time: 0.171499 Jul 26 03:18:05.386505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 439/853] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:18:05 2022] DELETE /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:18:05.396224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:05.396825 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:05.409197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:05.409726 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.410599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:05.411084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.610722 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:05.620687 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-94717a4c-b3be-483f-b79b-2282371a63cb tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1515 microversion: 2.1 time: 0.228988 Jul 26 03:18:05.621862 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 415/854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:05 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:18:05.875275 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:05.875998 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:05.882761 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:05.883460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.884370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:05.884795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:05.973883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:05.985751 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-20516b15-18b1-49c7-b926-419b20137487 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1383 microversion: 2.1 time: 0.114645 Jul 26 03:18:05.999792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 440/855] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:05 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1383 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:06.159318 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-730b2605-9792-402a-82b7-3e07496ea1d1 req-9712334a-7d54-46b6-93ee-933d6e8261f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63377566-399d-4621-a5e6-f027c80757cc", "name": "network-vif-plugged", "status": "completed", "tag": "25f60663-5598-468a-a8a5-3452cc7a77cc"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:06.172873 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-730b2605-9792-402a-82b7-3e07496ea1d1 req-9712334a-7d54-46b6-93ee-933d6e8261f3 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:06.173394 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-730b2605-9792-402a-82b7-3e07496ea1d1 req-9712334a-7d54-46b6-93ee-933d6e8261f3 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:06.189402 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-730b2605-9792-402a-82b7-3e07496ea1d1 req-9712334a-7d54-46b6-93ee-933d6e8261f3 service nova] Creating event network-vif-plugged:25f60663-5598-468a-a8a5-3452cc7a77cc for instance 63377566-399d-4621-a5e6-f027c80757cc on hv-cinder-85084 Jul 26 03:18:06.194834 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-730b2605-9792-402a-82b7-3e07496ea1d1 req-9712334a-7d54-46b6-93ee-933d6e8261f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039811 Jul 26 03:18:06.196200 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 416/856] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:18:06.364013 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:06.364652 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:06.374409 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:06.374847 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:06.375636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:06.376184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:06.540371 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:06.549311 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a8167de6-3f4a-42ae-9491-17a41f3d2229 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.189872 Jul 26 03:18:06.552964 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 441/857] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:06 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:06.643896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:06.645567 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:06.651806 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:06.652378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:06.653269 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:06.653973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:06.813942 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:06.828907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-76f0c78a-49d7-469d-8f9f-02fe45294595 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1515 microversion: 2.1 time: 0.189473 Jul 26 03:18:06.839323 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 417/858] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:06 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:07.014597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:07.015338 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:07.023190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:07.023666 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:07.024709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:07.025451 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:07.126928 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8697f1ada4214e15876b2c2ec6184ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd8a79690708464a9c3ffe381667a03c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:07.135650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1c229c42-9b29-4610-b12f-bc274cdca746 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 200 len: 1383 microversion: 2.1 time: 0.130798 Jul 26 03:18:07.136262 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 442/859] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:07 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 1383 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:07.574568 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:07.575440 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:07.585214 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:07.585983 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:07.586932 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:07.587543 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:07.765973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:07.779993 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a93b1207-d433-43c1-9131-3354610430dc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.205744 Jul 26 03:18:07.781847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 418/860] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:07 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:07.855221 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:07.856690 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:07.864557 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:07.865003 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:07.865853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:07.866282 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:08.126044 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:08.133734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-974d3e6e-f43a-446e-84f7-ffda9c0c0f4b tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1515 microversion: 2.1 time: 0.283952 Jul 26 03:18:08.134668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 443/861] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:07 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:08.160409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:08.162438 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] [instance: 1c126b57-79ad-4bd0-9f2a-db16536258e3] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:08.174742 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:08.175318 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:08.176175 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:08.176703 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:08.196967 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] HTTP exception thrown: Instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 could not be found. Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Request method failure captured: Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 HTTP/1.1 Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31uim34NWcaTv__583xfp58xWjCmmpeCTKuc6Z7qsqgOoix4OFRgDPZs8S0-qQvYfeePqDdleCqpesTxgfQ6HoTXhTe8LnzHlU2PEFZEPH9fU7ySnXnMMP5zG2bB_S0AAYP00FzOpIVGyQCe6kvNLiG2OyTtpevSMig5uK7P335FFP0 Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: bd8a79690708464a9c3ffe381667a03c Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-TestShelveInstance-455450799 Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:18:08.200258 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bd8a79690708464a9c3ffe381667a03c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bd8a79690708464a9c3ffe381667a03c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bd8a79690708464a9c3ffe381667a03c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bd8a79690708464a9c3ffe381667a03c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-TestShelveInstance-455450799 Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: bd8a79690708464a9c3ffe381667a03c Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-TestShelveInstance-455450799 Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-TestShelveInstance-455450799-project Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 8697f1ada4214e15876b2c2ec6184ed7 Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-TestShelveInstance-455450799-project Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 could not be found. Jul 26 03:18:08.201867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '1c126b57-79ad-4bd0-9f2a-db16536258e3'} Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 could not be found. Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:18:08.202914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 could not be found. Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 could not be found. Jul 26 03:18:08.204455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:08.206636 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Returning 404 to user: Instance 1c126b57-79ad-4bd0-9f2a-db16536258e3 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:18:08.208210 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-77a2c52e-c488-4346-b759-fdc110a39330 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3" status: 404 len: 111 microversion: 2.1 time: 0.054583 Jul 26 03:18:08.209822 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 419/862] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:08 2022] GET /compute/v2.1/servers/1c126b57-79ad-4bd0-9f2a-db16536258e3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:18:08.411814 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b99d368d-6da2-4561-937c-97949869c485 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] Calling method '.version_select at 0x7f5f7952e0d0>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:08.445558 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b99d368d-6da2-4561-937c-97949869c485 tempest-TestShelveInstance-455450799 tempest-TestShelveInstance-455450799-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1243734906" status: 202 len: 0 microversion: 2.1 time: 0.037062 Jul 26 03:18:08.446518 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 444/863] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Jul 26 03:18:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1243734906 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:18:08.511411 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-54dbb05c-1840-4076-9561-270f26b75eb9 req-f35748ed-9e10-48fa-bd34-e149a0200cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7865fb-14d2-413c-9f34-7402d70e4308", "name": "network-vif-deleted", "tag": "da24c78e-34a6-4221-98bb-d4574e9d6954"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:08.524246 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-54dbb05c-1840-4076-9561-270f26b75eb9 req-f35748ed-9e10-48fa-bd34-e149a0200cdb service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:08.525146 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-54dbb05c-1840-4076-9561-270f26b75eb9 req-f35748ed-9e10-48fa-bd34-e149a0200cdb service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:08.541345 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-54dbb05c-1840-4076-9561-270f26b75eb9 req-f35748ed-9e10-48fa-bd34-e149a0200cdb service nova] Creating event network-vif-deleted:da24c78e-34a6-4221-98bb-d4574e9d6954 for instance 8b7865fb-14d2-413c-9f34-7402d70e4308 on hv-cinder-85084 Jul 26 03:18:08.548510 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-54dbb05c-1840-4076-9561-270f26b75eb9 req-f35748ed-9e10-48fa-bd34-e149a0200cdb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041814 Jul 26 03:18:08.549504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 420/864] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:18:08.802088 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:08.802891 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:08.817909 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:08.818604 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:08.819576 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:08.820772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:09.032734 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:09.044217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8f267c52-bf54-4fdf-b56a-f347df0bdee4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1313 microversion: 2.1 time: 0.246212 Jul 26 03:18:09.055783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 445/865] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:08 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:09.160077 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:09.161597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:09.169409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:09.169868 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:09.170776 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:09.171215 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:09.206373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:09.206735 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:09.207634 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lazy-loading 'fault' on Instance uuid 8b7865fb-14d2-413c-9f34-7402d70e4308 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:18:09.288738 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c080fc8354ccf90391984baf6052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd77269b8504984b3e086be66ac9713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:09.299509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ee5c93ff-a3ae-4ca2-8a1f-9b9b4a90efb1 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 200 len: 1309 microversion: 2.1 time: 0.143811 Jul 26 03:18:09.300314 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 421/866] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:09 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 1309 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:10.065732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:10.066189 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:10.073518 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:10.074172 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:10.075122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:10.075923 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:10.099974 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:10.218072 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:10.226662 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5a58bfd4-0503-471b-b301-6a1dcb224312 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1498 microversion: 2.1 time: 0.164892 Jul 26 03:18:10.227732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 446/867] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:10 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:10.323187 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:10.324484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] [instance: 8b7865fb-14d2-413c-9f34-7402d70e4308] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:10.334705 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:10.335252 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:10.336418 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:10.336847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:10.355614 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] HTTP exception thrown: Instance 8b7865fb-14d2-413c-9f34-7402d70e4308 could not be found. Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Request method failure captured: Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 HTTP/1.1 Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31x9dEZ2Be3P6C9BhZ8_Fo3TAXcJCpRKagYaVP7_CzUmq4VlUlnzCFYV9-IgTfdgMiPvHiF98MZB9jCWm9Bch0mRME7KXWOWa0TblIDnfNM-obTjkS9EstogMuGS-iFlpUKRff9hHTzHHbw51MhFhDOnK5KYwiSwvROU0OjvWDzgukE Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: 8bd77269b8504984b3e086be66ac9713 Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1928390846 Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:18:10.358808 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8bd77269b8504984b3e086be66ac9713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8bd77269b8504984b3e086be66ac9713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8bd77269b8504984b3e086be66ac9713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8bd77269b8504984b3e086be66ac9713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-VolumesSnapshotTestJSON-1928390846 Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: 8bd77269b8504984b3e086be66ac9713 Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1928390846 Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-VolumesSnapshotTestJSON-1928390846-project Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: c70c080fc8354ccf90391984baf6052f Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-VolumesSnapshotTestJSON-1928390846-project Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 8b7865fb-14d2-413c-9f34-7402d70e4308 could not be found. Jul 26 03:18:10.360228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '8b7865fb-14d2-413c-9f34-7402d70e4308'} Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7865fb-14d2-413c-9f34-7402d70e4308 could not be found. Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:18:10.361049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7865fb-14d2-413c-9f34-7402d70e4308 could not be found. Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7865fb-14d2-413c-9f34-7402d70e4308 could not be found. Jul 26 03:18:10.362223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:10.363406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] Returning 404 to user: Instance 8b7865fb-14d2-413c-9f34-7402d70e4308 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:18:10.363406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-91cc0e0f-e8fa-43cf-a8bc-4025a4423d03 tempest-VolumesSnapshotTestJSON-1928390846 tempest-VolumesSnapshotTestJSON-1928390846-project] 10.222.0.42 "GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308" status: 404 len: 111 microversion: 2.1 time: 0.044793 Jul 26 03:18:10.366844 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 422/868] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:10 2022] GET /compute/v2.1/servers/8b7865fb-14d2-413c-9f34-7402d70e4308 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:18:11.026379 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:11.027396 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:11.037708 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:11.039957 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:11.042007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:11.043033 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:11.087049 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:18:11.201160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-f8e15ee7-b3df-4527-9a3e-9431e26e4617 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 204 len: 0 microversion: 2.1 time: 0.180911 Jul 26 03:18:11.201873 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 447/869] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:18:11 2022] DELETE /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:18:11.210193 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:11.210798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:11.217208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:11.217857 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:11.218775 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:11.219379 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:11.410816 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:11.422159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6b88aaff-33b7-4376-98f3-e66d955283ea tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1504 microversion: 2.1 time: 0.215786 Jul 26 03:18:11.423216 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 423/870] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:11 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:12.452146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:12.458247 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:12.466650 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:12.467582 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:12.468511 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:12.469227 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:12.672341 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:12.682023 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d0fce0db-b454-4c6a-a0d0-a900a9ab5119 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1504 microversion: 2.1 time: 0.238803 Jul 26 03:18:12.683467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 448/871] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:12 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:13.705798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:13.706989 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:13.714726 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:13.715490 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:13.716477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:13.717122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:13.740280 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:13.999511 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:14.010985 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-525e1a03-f3ef-4059-ac87-0050e928d109 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1504 microversion: 2.1 time: 0.309153 Jul 26 03:18:14.019850 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 424/872] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:13 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:15.032558 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:15.033163 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:15.044595 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:15.045079 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:15.045865 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:15.046295 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:15.409300 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:15.422242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-eba5049e-235e-4feb-a684-a6d1c3ffccaa tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1504 microversion: 2.1 time: 0.393332 Jul 26 03:18:15.422838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 449/873] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:15 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:15.968524 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-968f2011-e59e-4096-86d6-0247dd464c1d req-04237d33-621c-4e6b-b907-b083eb2a5c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63377566-399d-4621-a5e6-f027c80757cc", "name": "network-vif-deleted", "tag": "25f60663-5598-468a-a8a5-3452cc7a77cc"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:15.993004 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-968f2011-e59e-4096-86d6-0247dd464c1d req-04237d33-621c-4e6b-b907-b083eb2a5c5b service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:15.993717 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-968f2011-e59e-4096-86d6-0247dd464c1d req-04237d33-621c-4e6b-b907-b083eb2a5c5b service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:16.009737 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-968f2011-e59e-4096-86d6-0247dd464c1d req-04237d33-621c-4e6b-b907-b083eb2a5c5b service nova] Creating event network-vif-deleted:25f60663-5598-468a-a8a5-3452cc7a77cc for instance 63377566-399d-4621-a5e6-f027c80757cc on hv-cinder-85084 Jul 26 03:18:16.031966 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-968f2011-e59e-4096-86d6-0247dd464c1d req-04237d33-621c-4e6b-b907-b083eb2a5c5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062713 Jul 26 03:18:16.036626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 425/874] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:18:16.451894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:16.453345 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:16.465369 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:16.465759 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:16.468161 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:16.468802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:16.525966 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:16.526718 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:16.528627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.objects.instance [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lazy-loading 'fault' on Instance uuid 63377566-399d-4621-a5e6-f027c80757cc {{(pid=118060) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:18:16.608096 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:16.618718 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-58445025-2a25-4377-a611-dbb4775e6de4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 200 len: 1303 microversion: 2.1 time: 0.177757 Jul 26 03:18:16.622200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 450/875] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:16 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:17.642881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:17.643632 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 63377566-399d-4621-a5e6-f027c80757cc] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:17.650579 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:17.651059 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:17.652838 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:17.653728 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:17.677729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] HTTP exception thrown: Instance 63377566-399d-4621-a5e6-f027c80757cc could not be found. Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Request method failure captured: Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc HTTP/1.1 Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi31zggXw6swbChbY4FW1fANd6kSKxkUG953Scj4U9Ekx7E5U7j_B-BUHAUsDJ8pBvv2xdCe6fO37QX8lFGOy0f9JGB0FKj_YWAkKXfeCnqJzxh-K-fV5E_6dZOS1g9kT5K7ER91u6aQn7Gim_JuutIo_uRhEtR2X88kzhlAg9DhrDFps Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: ad3b89efcbc94f19a867fe700046b0f2 Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-VolumesActionsTest-688092015 Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:18:17.679997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-VolumesActionsTest-688092015 Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: ad3b89efcbc94f19a867fe700046b0f2 Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-VolumesActionsTest-688092015 Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-VolumesActionsTest-688092015-project Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 72614ab651224f4b9c0f2fb90806aadf Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-VolumesActionsTest-688092015-project Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance 63377566-399d-4621-a5e6-f027c80757cc could not be found. Jul 26 03:18:17.682671 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': '63377566-399d-4621-a5e6-f027c80757cc'} Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63377566-399d-4621-a5e6-f027c80757cc could not be found. Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:18:17.683693 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63377566-399d-4621-a5e6-f027c80757cc could not be found. Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63377566-399d-4621-a5e6-f027c80757cc could not be found. Jul 26 03:18:17.685219 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:18:17.688135 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Returning 404 to user: Instance 63377566-399d-4621-a5e6-f027c80757cc could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:18:17.689382 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-40fa9b33-218a-432f-9c98-369e9ae8d424 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc" status: 404 len: 111 microversion: 2.1 time: 0.052019 Jul 26 03:18:17.697609 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 426/876] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:17 2022] GET /compute/v2.1/servers/63377566-399d-4621-a5e6-f027c80757cc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:18:17.857990 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-302357815", "imageRef": "57246669-c482-48bf-82c8-e7cc9b55d350", "flavorRef": "452", "networks": [{"uuid": "2752ed4d-6948-4f25-a6ac-a31ddb1b8ff3"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:17.915431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] validate_networks() for [('2752ed4d-6948-4f25-a6ac-a31ddb1b8ff3', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:18:18.326715 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:18:18.328397 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:18:18.329193 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:18:18.329892 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:18:18.330643 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:18:18.348204 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:18.348999 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:18.350381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:18.351167 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:18.381557 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Getting quotas for project ad3b89efcbc94f19a867fe700046b0f2. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:18:18.388512 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Getting quotas for user 72614ab651224f4b9c0f2fb90806aadf and project ad3b89efcbc94f19a867fe700046b0f2. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:18:18.407656 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:18:18.411678 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57246669-c482-48bf-82c8-e7cc9b55d350',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:18:18.490251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a3a1157a-3676-40f3-8492-c13970ff5c80 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635705 Jul 26 03:18:18.492037 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 451/877] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:18:18.506764 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-cd0b8900-1a7a-4830-a3f2-2cf7782aeaec tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:18.507470 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-cd0b8900-1a7a-4830-a3f2-2cf7782aeaec tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:18.623923 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cd0b8900-1a7a-4830-a3f2-2cf7782aeaec tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:18.633788 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-cd0b8900-1a7a-4830-a3f2-2cf7782aeaec tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1213 microversion: 2.1 time: 0.133518 Jul 26 03:18:18.634373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 427/878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:18 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:19.655611 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:19.656217 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:19.663627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:19.664037 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:19.665017 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:19.665422 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:19.762783 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:19.773701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-36c491d9-ad45-4f18-a3ae-ad6d97905afd tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1265 microversion: 2.1 time: 0.122998 Jul 26 03:18:19.773952 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 452/879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:19 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:20.793714 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:20.794313 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:20.802005 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:20.802380 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:20.803181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:20.803610 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:20.939311 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:20.948426 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-902472ad-12f6-4a7a-9d36-babd0a79e494 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1313 microversion: 2.1 time: 0.158580 Jul 26 03:18:20.949011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 428/880] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:20 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:21.971958 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:21.972552 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:21.979316 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:21.979795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:21.980555 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:21.980984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:22.112764 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:22.120623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-641da470-f0a8-4280-849f-94f18fc410ca tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1313 microversion: 2.1 time: 0.152419 Jul 26 03:18:22.121257 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 453/881] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:21 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:22.789366 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-8d3b4447-0d1d-42d5-8f2f-9f20ffa3d2de req-9bdad7fa-72ef-499a-a4e1-bea84f6fe1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a5a10e-023c-420b-b1e1-132c28672932", "tag": "1beec55c-24f7-40b0-8d00-9e99e991760f"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:22.799342 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-8d3b4447-0d1d-42d5-8f2f-9f20ffa3d2de req-9bdad7fa-72ef-499a-a4e1-bea84f6fe1ca service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:22.799778 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-8d3b4447-0d1d-42d5-8f2f-9f20ffa3d2de req-9bdad7fa-72ef-499a-a4e1-bea84f6fe1ca service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:22.810720 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-8d3b4447-0d1d-42d5-8f2f-9f20ffa3d2de req-9bdad7fa-72ef-499a-a4e1-bea84f6fe1ca service nova] Creating event network-changed:1beec55c-24f7-40b0-8d00-9e99e991760f for instance 32a5a10e-023c-420b-b1e1-132c28672932 on hv-cinder-85084 Jul 26 03:18:22.815408 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-8d3b4447-0d1d-42d5-8f2f-9f20ffa3d2de req-9bdad7fa-72ef-499a-a4e1-bea84f6fe1ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029848 Jul 26 03:18:22.815990 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 429/882] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:18:23.142445 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:23.143069 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:23.152010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:23.152448 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:23.153184 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:23.153818 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:23.369248 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:23.377220 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-29ad9d5e-bd6e-4c9b-9f91-b2cda6c6ad27 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1313 microversion: 2.1 time: 0.238829 Jul 26 03:18:23.377792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 454/883] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:23 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:24.398984 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:24.400554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:24.404013 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:24.415444 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:24.416748 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:24.417611 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:24.418045 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:24.564824 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:24.577091 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-4765a87a-afea-4497-843b-cc92b06b1038 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1313 microversion: 2.1 time: 0.182902 Jul 26 03:18:24.577817 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 430/884] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:24 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:25.598074 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:25.598707 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:25.601308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:25.606795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:25.607264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:25.608035 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:25.608463 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:25.741023 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:25.748665 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-59e58480-5891-4323-8b13-fbfba46ab0a4 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1313 microversion: 2.1 time: 0.154706 Jul 26 03:18:25.749317 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 455/885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:25 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:26.769514 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:26.770073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:26.776756 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:26.777203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:26.777946 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:26.778402 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:26.911942 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:26.919926 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9d9e71b0-eb5e-4aa2-b2d8-6229402bf5fc tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1313 microversion: 2.1 time: 0.154276 Jul 26 03:18:26.920496 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 431/886] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:26 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:27.376472 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-0ab0ca5c-e138-4dbd-bc61-c0c22266c5ab req-a51c5d2d-dca7-46ea-be06-75f51678725d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a5a10e-023c-420b-b1e1-132c28672932", "name": "network-vif-plugged", "status": "completed", "tag": "1beec55c-24f7-40b0-8d00-9e99e991760f"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:27.394178 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0ab0ca5c-e138-4dbd-bc61-c0c22266c5ab req-a51c5d2d-dca7-46ea-be06-75f51678725d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:27.395273 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-0ab0ca5c-e138-4dbd-bc61-c0c22266c5ab req-a51c5d2d-dca7-46ea-be06-75f51678725d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:27.422571 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-0ab0ca5c-e138-4dbd-bc61-c0c22266c5ab req-a51c5d2d-dca7-46ea-be06-75f51678725d service nova] Creating event network-vif-plugged:1beec55c-24f7-40b0-8d00-9e99e991760f for instance 32a5a10e-023c-420b-b1e1-132c28672932 on hv-cinder-85084 Jul 26 03:18:27.429194 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-0ab0ca5c-e138-4dbd-bc61-c0c22266c5ab req-a51c5d2d-dca7-46ea-be06-75f51678725d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057148 Jul 26 03:18:27.430198 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 456/887] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:18:27.940795 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:27.941423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:27.948349 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:27.948796 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:27.949546 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:27.949975 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:28.084464 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:28.092228 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-c42e0647-5551-4172-9f3a-a63beb485120 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1313 microversion: 2.1 time: 0.155201 Jul 26 03:18:28.092785 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 432/888] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:27 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:29.111370 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:29.113470 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:29.117556 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:29.118244 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:29.126197 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:29.126806 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:29.127771 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:29.128200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:29.306401 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:29.319551 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-93a6ed58-876a-426b-89e1-8869f311e69a tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1497 microversion: 2.1 time: 0.209122 Jul 26 03:18:29.320742 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 457/889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:29 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:29.834487 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:18:29.839455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:29.839947 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:29.847874 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:29.848550 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:29.849480 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:29.849915 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:29.875899 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:18:29.973440 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5ebbd915-219e-4a15-a524-a2d1353d6c7e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "DELETE /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 204 len: 0 microversion: 2.1 time: 0.139338 Jul 26 03:18:29.974073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 433/890] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:18:29 2022] DELETE /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:18:29.983705 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:29.984444 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:29.991381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:29.992144 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:29.993142 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:29.993792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:30.153693 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:30.161322 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0e67c6fa-dbb3-45d5-ab33-faa9ffe8eeff tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1503 microversion: 2.1 time: 0.182469 Jul 26 03:18:30.161894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 458/891] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:29 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:31.184167 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:31.185992 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:31.193233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:31.196534 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:31.197741 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:31.198777 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:31.366492 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:31.374073 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-eae610ca-77ca-4bea-886a-0d346914e910 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1503 microversion: 2.1 time: 0.194354 Jul 26 03:18:31.374644 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 434/892] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:31 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:31.931219 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-21c7a39b-c66a-46a4-adca-0c0f7806e3b2 req-2373be73-4467-4fd9-b62e-b57824687402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a5a10e-023c-420b-b1e1-132c28672932", "name": "network-vif-deleted", "tag": "1beec55c-24f7-40b0-8d00-9e99e991760f"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:18:31.945138 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-21c7a39b-c66a-46a4-adca-0c0f7806e3b2 req-2373be73-4467-4fd9-b62e-b57824687402 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:31.945658 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-21c7a39b-c66a-46a4-adca-0c0f7806e3b2 req-2373be73-4467-4fd9-b62e-b57824687402 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:31.958229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-21c7a39b-c66a-46a4-adca-0c0f7806e3b2 req-2373be73-4467-4fd9-b62e-b57824687402 service nova] Creating event network-vif-deleted:1beec55c-24f7-40b0-8d00-9e99e991760f for instance 32a5a10e-023c-420b-b1e1-132c28672932 on hv-cinder-85084 Jul 26 03:18:31.964296 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-21c7a39b-c66a-46a4-adca-0c0f7806e3b2 req-2373be73-4467-4fd9-b62e-b57824687402 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036797 Jul 26 03:18:31.965017 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 459/893] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:18:32.395295 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:32.395980 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:32.404278 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:32.404689 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:32.405512 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:32.405949 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:32.444093 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:32.444544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:32.445552 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lazy-loading 'fault' on Instance uuid 32a5a10e-023c-420b-b1e1-132c28672932 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:18:32.509208 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72614ab651224f4b9c0f2fb90806aadf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad3b89efcbc94f19a867fe700046b0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:18:32.516257 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7e0d7307-b02f-4c46-8731-22dace2990d2 tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 200 len: 1303 microversion: 2.1 time: 0.125825 Jul 26 03:18:32.516822 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 435/894] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:32 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:18:33.538800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:18:33.539595 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] [instance: 32a5a10e-023c-420b-b1e1-132c28672932] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:18:33.546150 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:33.546605 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:33.547394 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:18:33.547863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:18:33.561587 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] HTTP exception thrown: Instance 32a5a10e-023c-420b-b1e1-132c28672932 could not be found. Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Request method failure captured: Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 HTTP/1.1 Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi31zggXw6swbChbY4FW1fANd6kSKxkUG953Scj4U9Ekx7E5U7j_B-BUHAUsDJ8pBvv2xdCe6fO37QX8lFGOy0f9JGB0FKj_YWAkKXfeCnqJzxh-K-fV5E_6dZOS1g9kT5K7ER91u6aQn7Gim_JuutIo_uRhEtR2X88kzhlAg9DhrDFps Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: ad3b89efcbc94f19a867fe700046b0f2 Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-VolumesActionsTest-688092015 Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:18:33.563284 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ad3b89efcbc94f19a867fe700046b0f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-VolumesActionsTest-688092015 Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: ad3b89efcbc94f19a867fe700046b0f2 Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-VolumesActionsTest-688092015 Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-VolumesActionsTest-688092015-project Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 72614ab651224f4b9c0f2fb90806aadf Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-VolumesActionsTest-688092015-project Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance 32a5a10e-023c-420b-b1e1-132c28672932 could not be found. Jul 26 03:18:33.564810 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': '32a5a10e-023c-420b-b1e1-132c28672932'} Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a5a10e-023c-420b-b1e1-132c28672932 could not be found. Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:18:33.565679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a5a10e-023c-420b-b1e1-132c28672932 could not be found. Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a5a10e-023c-420b-b1e1-132c28672932 could not be found. Jul 26 03:18:33.567057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:18:33.568281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] Returning 404 to user: Instance 32a5a10e-023c-420b-b1e1-132c28672932 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:18:33.568281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-1a0321e4-5933-4c9d-b4c3-23614727577e tempest-VolumesActionsTest-688092015 tempest-VolumesActionsTest-688092015-project] 10.222.0.42 "GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932" status: 404 len: 111 microversion: 2.1 time: 0.030665 Jul 26 03:18:33.568281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 460/895] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:18:33 2022] GET /compute/v2.1/servers/32a5a10e-023c-420b-b1e1-132c28672932 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:19:36.664137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:19:36.664901 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:19:36.669136 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-73bda2ab-c773-4ad0-9328-28a710bb84ae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Action: 'create', calling method: .version_select at 0x7f5f795bd670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1413699766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKUXIE5wLIeVMDf+dYUtUM6TmxFU0HFMGplpN0EzfvoJJof8vE4TwsZBEmtvjiQoouwX9q0B7hEVMJmdXls0knLhpcg8jXVY7s2KewgMTnlGUH8fPn4Cg+rutw21S6Wbw=="}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:19:36.687484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-73bda2ab-c773-4ad0-9328-28a710bb84ae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Getting quotas for project ac6c4069e73d4966aa373c5cc84d8c00. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:19:36.691374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-73bda2ab-c773-4ad0-9328-28a710bb84ae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Getting quotas for user 219301d335c348358d8aaa63b86ddcc9 and project ac6c4069e73d4966aa373c5cc84d8c00. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:19:36.713690 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-73bda2ab-c773-4ad0-9328-28a710bb84ae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051401 Jul 26 03:19:36.714271 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 436/896] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:19:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:19:36.815855 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=11 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:19:36.816892 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:19:36.821665 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1310525831", "imageRef": "a27df434-f065-4731-b2ff-fc05979fcdb0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1413699766", "networks": [{"uuid": "b0133bb5-6dfa-48ef-ab85-3d0859eda23f"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:19:36.879400 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] validate_networks() for [('b0133bb5-6dfa-48ef-ab85-3d0859eda23f', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:19:37.252462 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:19:37.253185 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:19:37.253657 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:19:37.254057 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:19:37.254515 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:19:37.263537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:37.263981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:37.264782 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:37.265251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:37.282828 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Getting quotas for project ac6c4069e73d4966aa373c5cc84d8c00. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:19:37.287313 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Getting quotas for user 219301d335c348358d8aaa63b86ddcc9 and project ac6c4069e73d4966aa373c5cc84d8c00. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:19:37.299275 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:19:37.301536 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a27df434-f065-4731-b2ff-fc05979fcdb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:19:37.349673 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4d3962fc-701f-4437-8d8f-0f9290eed3c5 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535626 Jul 26 03:19:37.350395 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 461/897] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:19:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:19:37.363207 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e21b4bc9-174d-4e58-8944-5b69050f002d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:37.363826 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e21b4bc9-174d-4e58-8944-5b69050f002d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:37.437218 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e21b4bc9-174d-4e58-8944-5b69050f002d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:37.444882 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e21b4bc9-174d-4e58-8944-5b69050f002d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1259 microversion: 2.1 time: 0.087787 Jul 26 03:19:37.445440 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 437/898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:37 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1259 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:38.466505 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:38.467424 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:38.473735 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:38.474176 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:38.474934 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:38.475396 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:38.549311 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:38.558260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-7272bc09-7b40-4b97-b943-c8bc4a6c0d59 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1329 microversion: 2.1 time: 0.096308 Jul 26 03:19:38.558804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 462/899] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:38 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:39.580202 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:39.580896 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:39.588018 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:39.588463 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:39.589223 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:39.589646 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:39.748822 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:39.764199 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a497a6af-e6e6-45b8-ac1b-152bd40677d8 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.187739 Jul 26 03:19:39.764898 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 438/900] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:39 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:19:40.787457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:40.788291 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:40.796054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:40.796777 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:40.797563 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:40.798142 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:40.945713 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:40.954101 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4554c7a6-7ce0-4fdb-ac79-5ac00acc4a7f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.171644 Jul 26 03:19:40.954671 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 463/901] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:40 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:41.976630 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:41.978158 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:41.988265 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:41.988704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:41.989481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:41.989910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:42.153997 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:42.162878 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f4b2b4a2-d612-42c2-89e9-6e063a54472e tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.190559 Jul 26 03:19:42.165030 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 439/902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:41 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:43.188857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:43.189360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:43.196146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:43.196804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:43.197880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:43.198465 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:43.337363 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:43.345731 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-34a40202-8d4c-4872-ab42-411c3fb07daa tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.160973 Jul 26 03:19:43.346890 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 464/903] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:43 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:44.368758 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:44.372682 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:44.386639 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:44.387960 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:44.391527 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:44.392153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:44.580762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:44.588540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bd41a9f2-ca4f-4140-92c5-ea3a3ace2fa2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.223828 Jul 26 03:19:44.589417 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 440/904] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:44 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:45.612574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:45.612574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:45.621243 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:45.622067 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:45.623206 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:45.623903 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:45.779683 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:45.789626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6a25ee36-0605-4069-a387-f32b1a09049c tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.183273 Jul 26 03:19:45.796946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 465/905] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:45 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:46.818656 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:46.819888 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:46.829462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:46.829915 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:46.830648 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:46.831111 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:46.966496 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:46.974498 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ee2dfb4d-617f-49e8-96d8-64efc19571bf tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.164695 Jul 26 03:19:46.975085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 441/906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:46 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:47.639446 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-bba5bf8a-ed89-4199-af00-a4cdd0ee5df7 req-3b2e0e40-9cfd-4667-9bc3-280c25fa48d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f39307-f72e-48c5-834e-060eeead7f22", "tag": "159811d2-c9da-4a22-9fad-b19a2ca33738"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:19:47.647957 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:19:47.648631 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:19:47.656730 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-bba5bf8a-ed89-4199-af00-a4cdd0ee5df7 req-3b2e0e40-9cfd-4667-9bc3-280c25fa48d5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:47.657475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-bba5bf8a-ed89-4199-af00-a4cdd0ee5df7 req-3b2e0e40-9cfd-4667-9bc3-280c25fa48d5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:47.671802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-bba5bf8a-ed89-4199-af00-a4cdd0ee5df7 req-3b2e0e40-9cfd-4667-9bc3-280c25fa48d5 service nova] Creating event network-changed:159811d2-c9da-4a22-9fad-b19a2ca33738 for instance a6f39307-f72e-48c5-834e-060eeead7f22 on hv-cinder-85084 Jul 26 03:19:47.677766 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-bba5bf8a-ed89-4199-af00-a4cdd0ee5df7 req-3b2e0e40-9cfd-4667-9bc3-280c25fa48d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041961 Jul 26 03:19:47.678307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 466/907] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:19:47.995969 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:47.996743 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:47.999517 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=6 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:19:48.006516 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:48.006516 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:48.007309 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:48.007748 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:48.178082 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:48.187121 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-67ad6bfb-8601-4678-a5ad-6f67b8f1c567 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.194830 Jul 26 03:19:48.202413 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 442/908] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:47 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:49.210576 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:49.211607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:49.218495 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:49.218981 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:49.219800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:49.220194 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:49.426691 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:49.434541 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-23c96b5d-8813-4c4a-8c2b-fdf30361c800 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.228172 Jul 26 03:19:49.435100 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 467/909] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:49 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:50.456787 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:50.457408 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:50.464317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:50.464766 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:50.465529 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:50.465966 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:50.605282 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:50.613000 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-274fb0bc-b790-4f6a-a16d-cf5dd9cd3c88 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.160100 Jul 26 03:19:50.613569 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 443/910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:50 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:51.634251 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:51.634861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:51.641919 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:51.642360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:51.643141 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:51.643582 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:51.777205 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:51.785043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-594255d4-a74e-4508-853b-5886b52492e9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.154790 Jul 26 03:19:51.785607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 468/911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:51 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:52.711707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-cf996fe5-5053-4349-860f-23f986490ece req-2871b7d0-33c7-4ec1-ad35-aca7fdebc606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f39307-f72e-48c5-834e-060eeead7f22", "name": "network-vif-plugged", "status": "completed", "tag": "159811d2-c9da-4a22-9fad-b19a2ca33738"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:19:52.722006 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-cf996fe5-5053-4349-860f-23f986490ece req-2871b7d0-33c7-4ec1-ad35-aca7fdebc606 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:52.722468 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-cf996fe5-5053-4349-860f-23f986490ece req-2871b7d0-33c7-4ec1-ad35-aca7fdebc606 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:52.734973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-cf996fe5-5053-4349-860f-23f986490ece req-2871b7d0-33c7-4ec1-ad35-aca7fdebc606 service nova] Creating event network-vif-plugged:159811d2-c9da-4a22-9fad-b19a2ca33738 for instance a6f39307-f72e-48c5-834e-060eeead7f22 on hv-cinder-85084 Jul 26 03:19:52.740081 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-cf996fe5-5053-4349-860f-23f986490ece req-2871b7d0-33c7-4ec1-ad35-aca7fdebc606 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032110 Jul 26 03:19:52.740667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 444/912] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:19:52.805925 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:52.806574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:52.813292 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:52.813752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:52.814578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:52.815042 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:52.997571 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:53.001068 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-fdec2c7f-0ff4-43b6-88f0-f4fe681e3da9 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.199039 Jul 26 03:19:53.001756 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 469/913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:52 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:19:54.022657 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:54.023378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:54.030507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:54.030970 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:54.031749 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:54.032181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:54.162090 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:54.169760 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-32e43334-92ca-4af0-99ce-708940cbe89a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1359 microversion: 2.1 time: 0.151421 Jul 26 03:19:54.170321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 445/914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:54 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:55.195437 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:55.196436 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:55.207618 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.208261 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:55.209521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.210306 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:55.352269 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:55.360048 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d26f3e68-829d-4a33-a5ef-5d364e3f154f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1548 microversion: 2.1 time: 0.171583 Jul 26 03:19:55.360616 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 470/915] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:55 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:55.380733 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:55.381308 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:55.388241 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.388684 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:55.389436 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.389878 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:55.527245 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:55.534827 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-5b873ada-7642-4d12-b623-d2ff341b1549 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1548 microversion: 2.1 time: 0.157953 Jul 26 03:19:55.535417 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 446/916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:55 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:55.557426 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:55.564636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:55.565467 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Searching by: {'deleted': False, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00'} {{(pid=118060) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 03:19:55.574190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.574637 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:55.575870 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.576507 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:55.669286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.multi_cell_list [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118060) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 03:19:55.926879 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e5841b92-527d-4cac-bc53-90db8ee015db tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.375408 Jul 26 03:19:55.927504 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 471/917] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Jul 26 03:19:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:19:55.941555 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:19:55.942173 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:55.948981 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.949421 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:55.950176 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:55.950603 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:56.087341 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:19:56.095150 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bec3be8b-e223-451a-9cec-2f52b5fece47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1548 microversion: 2.1 time: 0.159232 Jul 26 03:19:56.095709 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 447/918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:19:55 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:19:57.656537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c45ba9e7-9c23-471b-9289-a5d59a6da405 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "608569da-97bf-4cfd-83ce-fe127df50765"}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:19:57.658902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c45ba9e7-9c23-471b-9289-a5d59a6da405 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:19:57.665638 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c45ba9e7-9c23-471b-9289-a5d59a6da405 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:57.666079 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c45ba9e7-9c23-471b-9289-a5d59a6da405 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:57.666832 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c45ba9e7-9c23-471b-9289-a5d59a6da405 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:19:57.667361 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c45ba9e7-9c23-471b-9289-a5d59a6da405 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:19:57.928062 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c45ba9e7-9c23-471b-9289-a5d59a6da405 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275280 Jul 26 03:19:57.928701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 472/919] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Jul 26 03:19:57 2022] POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:20:04.530374 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:04.530973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:04.537846 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:04.538295 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:04.539066 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:04.539490 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:04.673017 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:04.685787 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9e8a134e-7201-46e7-bc1b-92e194761bda tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1594 microversion: 2.1 time: 0.159112 Jul 26 03:20:04.686544 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 448/920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:04 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:06.708441 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:06.713229 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-cb93ba26-816c-4299-8b2d-9d22e7cd0cd2 req-ce210b6b-b479-4c97-8741-ea0db75955fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f39307-f72e-48c5-834e-060eeead7f22", "tag": "159811d2-c9da-4a22-9fad-b19a2ca33738"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:20:06.723561 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-cb93ba26-816c-4299-8b2d-9d22e7cd0cd2 req-ce210b6b-b479-4c97-8741-ea0db75955fc service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:06.724067 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-cb93ba26-816c-4299-8b2d-9d22e7cd0cd2 req-ce210b6b-b479-4c97-8741-ea0db75955fc service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:06.736534 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-cb93ba26-816c-4299-8b2d-9d22e7cd0cd2 req-ce210b6b-b479-4c97-8741-ea0db75955fc service nova] Creating event network-changed:159811d2-c9da-4a22-9fad-b19a2ca33738 for instance a6f39307-f72e-48c5-834e-060eeead7f22 on hv-cinder-85084 Jul 26 03:20:06.741844 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-cb93ba26-816c-4299-8b2d-9d22e7cd0cd2 req-ce210b6b-b479-4c97-8741-ea0db75955fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034652 Jul 26 03:20:06.742509 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 473/921] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:20:08.125044 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1982125173"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:20:08.125574 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:08.128031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:08.133315 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:08.133778 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:08.134526 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:08.134977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:08.139244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=63 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:08.260977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.network.security_group_api [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Adding security group 85757bfa-ae92-44df-8622-137fe23985fa to port 159811d2-c9da-4a22-9fad-b19a2ca33738 Jul 26 03:20:08.611099 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9f1d435e-def7-41df-868e-ea2edd9b14a6 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/action" status: 202 len: 0 microversion: 2.1 time: 0.489885 Jul 26 03:20:08.612789 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 449/922] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:20:08 2022] POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:20:08.624017 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:08.625272 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:08.631071 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:08.641060 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:08.641511 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:08.642278 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:08.642701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:08.655104 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:08.758409 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-749730d3-3008-4072-8690-9f467ef63618 req-fad0a93f-fc79-466a-9840-3e3b4e1034f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f39307-f72e-48c5-834e-060eeead7f22", "tag": "159811d2-c9da-4a22-9fad-b19a2ca33738"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:20:08.769192 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-749730d3-3008-4072-8690-9f467ef63618 req-fad0a93f-fc79-466a-9840-3e3b4e1034f8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:08.769910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-749730d3-3008-4072-8690-9f467ef63618 req-fad0a93f-fc79-466a-9840-3e3b4e1034f8 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:08.787677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-749730d3-3008-4072-8690-9f467ef63618 req-fad0a93f-fc79-466a-9840-3e3b4e1034f8 service nova] Creating event network-changed:159811d2-c9da-4a22-9fad-b19a2ca33738 for instance a6f39307-f72e-48c5-834e-060eeead7f22 on hv-cinder-85084 Jul 26 03:20:08.795230 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-749730d3-3008-4072-8690-9f467ef63618 req-fad0a93f-fc79-466a-9840-3e3b4e1034f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040214 Jul 26 03:20:08.796564 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 450/923] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:20:08.825480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:08.839525 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-84a71e31-28d6-46a3-ae50-a5f548cbd5f1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1759 microversion: 2.1 time: 0.220365 Jul 26 03:20:08.841076 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 474/924] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:08 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1759 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:20:31.181251 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:31.181999 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=5 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:31.186137 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-bd83d1e0-3894-426b-a635-802f5b9dbd44 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:20:31.188438 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-bd83d1e0-3894-426b-a635-802f5b9dbd44 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:31.195969 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd83d1e0-3894-426b-a635-802f5b9dbd44 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:31.196404 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd83d1e0-3894-426b-a635-802f5b9dbd44 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:31.197185 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd83d1e0-3894-426b-a635-802f5b9dbd44 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:31.197607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-bd83d1e0-3894-426b-a635-802f5b9dbd44 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:31.276426 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-bd83d1e0-3894-426b-a635-802f5b9dbd44 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/action" status: 202 len: 0 microversion: 2.1 time: 0.096291 Jul 26 03:20:31.276957 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 451/925] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:20:31 2022] POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:20:31.286115 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:31.286720 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:31.289127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:31.289800 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=5 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:20:31.296709 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:31.297139 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:31.297913 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:31.298880 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:31.517944 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:31.526211 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d4241709-a1f9-4d5b-9ff7-b542f782ad07 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1751 microversion: 2.1 time: 0.244482 Jul 26 03:20:31.526861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 475/926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:31 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1751 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:20:32.553664 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:32.554842 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:32.562375 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:32.562826 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:32.563623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:32.564053 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:32.721249 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:32.729369 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b0f60a1f-7926-4f9a-8f5a-d27365b6e72a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.183566 Jul 26 03:20:32.729905 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 452/927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:32 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:33.755037 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:33.755906 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:33.764226 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:33.764674 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:33.765435 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:33.765863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:33.918355 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:33.931014 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9c6f4a39-85b9-4bcf-b2ae-3cca6b1f4435 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.182298 Jul 26 03:20:33.931804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 476/928] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:33 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:34.957122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:34.958065 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:34.969042 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:34.969777 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:34.971033 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:34.971760 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:35.256453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:35.265166 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-68ea8938-f89b-4392-9c5a-74f1d67d08a3 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.314492 Jul 26 03:20:35.265735 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 453/929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:34 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:36.289722 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:36.290337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:36.298852 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:36.299626 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:36.300482 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:36.300918 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:36.500363 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:36.508752 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d4059aa1-633a-403e-95e3-66860532520b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.224920 Jul 26 03:20:36.509304 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 477/930] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:36 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:37.533383 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:37.534053 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:37.543168 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:37.543612 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:37.544371 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:37.544795 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:37.689620 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:37.701855 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-72321042-1719-4cf4-97ed-a809ffba4d5d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.174428 Jul 26 03:20:37.702588 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 454/931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:37 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:38.730913 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:38.731910 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:38.742829 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:38.744012 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:38.745115 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:38.745831 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:38.902938 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:38.915165 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4eabf078-8ba6-4bf3-959e-eec57ac9dedd tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.190498 Jul 26 03:20:38.915942 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 478/932] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:38 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:39.944462 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:39.945412 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:39.955704 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:39.956440 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:39.957684 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:39.958395 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:40.102536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:40.111264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7ad64c09-77d6-4e88-be00-acb5f4c5706a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.173745 Jul 26 03:20:40.111819 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 455/933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:39 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:41.137022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:41.138047 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:41.148664 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:41.149308 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:41.150571 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:41.151337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:41.308805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:41.316992 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-0bdc094e-d275-4140-8164-d4237e7ffdae tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.186711 Jul 26 03:20:41.317920 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 479/934] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:41 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:42.343244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:42.344102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:42.355443 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:42.356149 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:42.357501 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:42.358221 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:42.515855 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:42.528534 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ab155a5a-3a47-4170-a7a1-a3ed913eae67 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.191776 Jul 26 03:20:42.529244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 456/935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:42 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:43.554033 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:43.554618 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:43.561935 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:43.562320 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:43.563124 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:43.563560 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:43.781415 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:43.789860 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-43b723ee-42dc-427c-b3d1-d01f429713a2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.239833 Jul 26 03:20:43.790407 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 480/936] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:43 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:44.811788 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:44.812375 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:44.820029 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:44.820539 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:44.821369 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:44.821883 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:44.964472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:44.972970 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-252c5845-9cec-4839-9406-2ff6752d411b tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.165232 Jul 26 03:20:44.973539 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 457/937] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:44 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:45.998994 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:45.999700 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:46.009326 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:46.009882 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:46.010826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:46.011394 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:46.163826 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:46.173238 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6832ad78-e457-48f1-93d4-95c0f87424ec tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.180785 Jul 26 03:20:46.173836 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 481/938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:45 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:47.198821 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:47.199497 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:47.207084 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:47.207529 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:47.208287 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:47.208713 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:47.361489 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:47.372011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-de75b433-245a-49c7-8c75-97009160f6c1 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1756 microversion: 2.1 time: 0.180043 Jul 26 03:20:47.372574 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 458/939] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:47 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:48.397917 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:20:48.398907 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:20:48.410183 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:48.410931 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:48.412243 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:20:48.412960 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:20:48.567674 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:20:48.576559 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-594f64c9-caac-4e7b-85a4-8fe53c4f8e2a tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1759 microversion: 2.1 time: 0.185239 Jul 26 03:20:48.577130 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 482/940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:20:48 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:20:50.348379 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:20:50.349291 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Tue Jul 26 03:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:20:56.811423 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:20:56.812307 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Tue Jul 26 03:20:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:21:21.557713 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1982125173"}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:21:21.558371 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:21.560795 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=16 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:21:21.561563 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:21:21.568477 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:21.568925 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:21.569663 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:21.570116 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:21.703848 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.network.security_group_api [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Removing security group 85757bfa-ae92-44df-8622-137fe23985fa from port 159811d2-c9da-4a22-9fad-b19a2ca33738 Jul 26 03:21:22.042095 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-db5af24a-4a00-43e5-9a52-a1f2e3691bd2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/action" status: 202 len: 0 microversion: 2.1 time: 0.488306 Jul 26 03:21:22.046780 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 459/941] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Jul 26 03:21:21 2022] POST /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:21:22.049373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-622c81cb-49c3-4717-95f2-e998006d43e6 req-2517fcdd-96ca-4200-a545-6bf58df61237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f39307-f72e-48c5-834e-060eeead7f22", "tag": "159811d2-c9da-4a22-9fad-b19a2ca33738"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:21:22.080259 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=16 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:21:22.081330 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=48 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:21:22.083551 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-622c81cb-49c3-4717-95f2-e998006d43e6 req-2517fcdd-96ca-4200-a545-6bf58df61237 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:22.087288 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-622c81cb-49c3-4717-95f2-e998006d43e6 req-2517fcdd-96ca-4200-a545-6bf58df61237 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:22.102160 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-622c81cb-49c3-4717-95f2-e998006d43e6 req-2517fcdd-96ca-4200-a545-6bf58df61237 service nova] Creating event network-changed:159811d2-c9da-4a22-9fad-b19a2ca33738 for instance a6f39307-f72e-48c5-834e-060eeead7f22 on hv-cinder-85084 Jul 26 03:21:22.109328 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-622c81cb-49c3-4717-95f2-e998006d43e6 req-2517fcdd-96ca-4200-a545-6bf58df61237 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062752 Jul 26 03:21:22.111498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 483/942] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:21:23.123919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:23.124464 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:23.130689 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:23.131252 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:23.132069 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:23.132489 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:23.224441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lazy-loading 'services' on Instance uuid a6f39307-f72e-48c5-834e-060eeead7f22 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:21:23.302865 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-24e7e6ab-a61a-487d-a891-b94e715013f0 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments/608569da-97bf-4cfd-83ce-fe127df50765" status: 202 len: 0 microversion: 2.1 time: 0.183407 Jul 26 03:21:23.303632 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 460/943] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:21:23 2022] DELETE /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments/608569da-97bf-4cfd-83ce-fe127df50765 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:21:23.313104 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3ecf2267-922c-4885-8d4c-ca9d8dae9e95 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:23.316552 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3ecf2267-922c-4885-8d4c-ca9d8dae9e95 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:23.324144 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ecf2267-922c-4885-8d4c-ca9d8dae9e95 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:23.324781 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ecf2267-922c-4885-8d4c-ca9d8dae9e95 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:23.325879 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ecf2267-922c-4885-8d4c-ca9d8dae9e95 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:23.326440 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3ecf2267-922c-4885-8d4c-ca9d8dae9e95 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:23.359885 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3ecf2267-922c-4885-8d4c-ca9d8dae9e95 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051212 Jul 26 03:21:23.360480 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 484/944] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:21:23 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:21:24.125422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-36495608-4571-46dd-9f3d-b8ee222b06db req-1d0fd249-7f90-4bae-9721-129b5db895fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f39307-f72e-48c5-834e-060eeead7f22", "tag": "159811d2-c9da-4a22-9fad-b19a2ca33738"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:21:24.137009 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-36495608-4571-46dd-9f3d-b8ee222b06db req-1d0fd249-7f90-4bae-9721-129b5db895fe service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:24.137515 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-36495608-4571-46dd-9f3d-b8ee222b06db req-1d0fd249-7f90-4bae-9721-129b5db895fe service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:24.148867 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-36495608-4571-46dd-9f3d-b8ee222b06db req-1d0fd249-7f90-4bae-9721-129b5db895fe service nova] Creating event network-changed:159811d2-c9da-4a22-9fad-b19a2ca33738 for instance a6f39307-f72e-48c5-834e-060eeead7f22 on hv-cinder-85084 Jul 26 03:21:24.153798 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-36495608-4571-46dd-9f3d-b8ee222b06db req-1d0fd249-7f90-4bae-9721-129b5db895fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033240 Jul 26 03:21:24.154382 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 461/945] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:21:24.372689 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-20152226-afa7-438b-bada-e40ab196b4e2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:24.374852 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-20152226-afa7-438b-bada-e40ab196b4e2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:24.381520 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20152226-afa7-438b-bada-e40ab196b4e2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:24.381971 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20152226-afa7-438b-bada-e40ab196b4e2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:24.382739 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20152226-afa7-438b-bada-e40ab196b4e2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:24.383209 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-20152226-afa7-438b-bada-e40ab196b4e2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:24.420092 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-20152226-afa7-438b-bada-e40ab196b4e2 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051360 Jul 26 03:21:24.420707 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 485/946] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Jul 26 03:21:24 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 03:21:24.433466 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:24.434261 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:24.444504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:24.444986 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:24.446085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:24.446662 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:24.525645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] HTTP exception thrown: Instance a6f39307-f72e-48c5-834e-060eeead7f22 is not attached to volume 608569da-97bf-4cfd-83ce-fe127df50765 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Request method failure captured: Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments/608569da-97bf-4cfd-83ce-fe127df50765 HTTP/1.1 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi3106BTMugI4DpJEZ1tCZ7gFi7XpfKonX9jjhq75lPZpM0nXADfPsyUxOMqymoyS27R2pgXTA5rHbtfMC-xskcYmKHDL1G5gHkhpmd64pIGD1o29IpLEaeOKugAcgzF4_bd4shkTttAyNtJiufPXDUdy2IJcIyLTH1-PJ2uPp09Nf_o8 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: ac6c4069e73d4966aa373c5cc84d8c00 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-TestMinimumBasicScenario-1039113142 Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:21:24.528072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-TestMinimumBasicScenario-1039113142 Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: ac6c4069e73d4966aa373c5cc84d8c00 Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1039113142 Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-TestMinimumBasicScenario-1039113142-project Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 219301d335c348358d8aaa63b86ddcc9 Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-TestMinimumBasicScenario-1039113142-project Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:21:24.529725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance a6f39307-f72e-48c5-834e-060eeead7f22 is not attached to volume 608569da-97bf-4cfd-83ce-fe127df50765 Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'server_id': 'a6f39307-f72e-48c5-834e-060eeead7f22', 'id': '608569da-97bf-4cfd-83ce-fe127df50765'} Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 608569da-97bf-4cfd-83ce-fe127df50765. Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:21:24.530513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f39307-f72e-48c5-834e-060eeead7f22 is not attached to volume 608569da-97bf-4cfd-83ce-fe127df50765 Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f39307-f72e-48c5-834e-060eeead7f22 is not attached to volume 608569da-97bf-4cfd-83ce-fe127df50765 Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:24.531831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Returning 404 to user: Instance a6f39307-f72e-48c5-834e-060eeead7f22 is not attached to volume 608569da-97bf-4cfd-83ce-fe127df50765 {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:21:24.532881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b942e777-4eb9-4b23-8529-50bfcb0c4037 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments/608569da-97bf-4cfd-83ce-fe127df50765" status: 404 len: 154 microversion: 2.1 time: 0.101777 Jul 26 03:21:24.532881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 462/947] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Jul 26 03:21:24 2022] DELETE /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22/os-volume_attachments/608569da-97bf-4cfd-83ce-fe127df50765 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:21:25.681294 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:25.681795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:25.691892 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:25.692349 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:25.693114 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:25.693544 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:25.718245 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:21:25.797010 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-44169189-5c2c-428c-8f84-8b502cc34c0f tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 204 len: 0 microversion: 2.1 time: 0.121721 Jul 26 03:21:25.797510 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 486/948] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:21:25 2022] DELETE /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:21:25.806969 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:25.807575 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:25.814276 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:25.814716 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:25.815499 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:25.815922 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:25.943743 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:21:25.951627 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-04337d29-2c7a-4fcf-85af-31f94c43a381 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1554 microversion: 2.1 time: 0.149066 Jul 26 03:21:25.952188 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 463/949] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:21:25 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:21:26.978146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:26.979318 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:26.990318 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:26.991109 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:26.992352 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:26.993110 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:27.136763 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:21:27.148410 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-298525b4-936f-4634-a3f5-92df26bbfb47 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1554 microversion: 2.1 time: 0.177212 Jul 26 03:21:27.149276 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 487/950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:21:26 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:21:28.169914 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:28.171304 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:28.187245 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:28.187688 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:28.188460 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:28.188883 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:28.256066 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '219301d335c348358d8aaa63b86ddcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac6c4069e73d4966aa373c5cc84d8c00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:21:28.264553 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-f2fc12f5-2a61-4fe9-baa0-d8002b3bcb10 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 200 len: 1512 microversion: 2.1 time: 0.098516 Jul 26 03:21:28.265232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 464/951] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:21:28 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 1512 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:21:28.297377 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-33edaa2e-b3da-431b-a915-a2ff94e87caa req-99600fbc-88f2-4f4d-b730-c5e74c6bf838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f39307-f72e-48c5-834e-060eeead7f22", "name": "network-vif-deleted", "tag": "159811d2-c9da-4a22-9fad-b19a2ca33738"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:21:28.307289 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-33edaa2e-b3da-431b-a915-a2ff94e87caa req-99600fbc-88f2-4f4d-b730-c5e74c6bf838 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:28.307732 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-33edaa2e-b3da-431b-a915-a2ff94e87caa req-99600fbc-88f2-4f4d-b730-c5e74c6bf838 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:28.319936 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-33edaa2e-b3da-431b-a915-a2ff94e87caa req-99600fbc-88f2-4f4d-b730-c5e74c6bf838 service nova] Creating event network-vif-deleted:159811d2-c9da-4a22-9fad-b19a2ca33738 for instance a6f39307-f72e-48c5-834e-060eeead7f22 on hv-cinder-85084 Jul 26 03:21:28.324545 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-33edaa2e-b3da-431b-a915-a2ff94e87caa req-99600fbc-88f2-4f4d-b730-c5e74c6bf838 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092469 Jul 26 03:21:28.325161 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 488/952] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:21:29.286101 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:29.286782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] [instance: a6f39307-f72e-48c5-834e-060eeead7f22] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:21:29.293847 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:29.294300 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:29.295072 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:21:29.295499 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:21:29.311289 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] HTTP exception thrown: Instance a6f39307-f72e-48c5-834e-060eeead7f22 could not be found. Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Request method failure captured: Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 HTTP/1.1 Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi3106BTMugI4DpJEZ1tCZ7gFi7XpfKonX9jjhq75lPZpM0nXADfPsyUxOMqymoyS27R2pgXTA5rHbtfMC-xskcYmKHDL1G5gHkhpmd64pIGD1o29IpLEaeOKugAcgzF4_bd4shkTttAyNtJiufPXDUdy2IJcIyLTH1-PJ2uPp09Nf_o8 Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: ac6c4069e73d4966aa373c5cc84d8c00 Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-TestMinimumBasicScenario-1039113142 Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:21:29.312837 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ac6c4069e73d4966aa373c5cc84d8c00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-TestMinimumBasicScenario-1039113142 Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: ac6c4069e73d4966aa373c5cc84d8c00 Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1039113142 Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-TestMinimumBasicScenario-1039113142-project Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 219301d335c348358d8aaa63b86ddcc9 Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-TestMinimumBasicScenario-1039113142-project Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance a6f39307-f72e-48c5-834e-060eeead7f22 could not be found. Jul 26 03:21:29.314414 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'a6f39307-f72e-48c5-834e-060eeead7f22'} Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f39307-f72e-48c5-834e-060eeead7f22 could not be found. Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:21:29.315536 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f39307-f72e-48c5-834e-060eeead7f22 could not be found. Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f39307-f72e-48c5-834e-060eeead7f22 could not be found. Jul 26 03:21:29.317482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:21:29.319385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Returning 404 to user: Instance a6f39307-f72e-48c5-834e-060eeead7f22 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:21:29.319385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-807d87dc-d38f-4afc-bbfb-ef1c43b39946 tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22" status: 404 len: 111 microversion: 2.1 time: 0.032174 Jul 26 03:21:29.319385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 465/953] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:21:29 2022] GET /compute/v2.1/servers/a6f39307-f72e-48c5-834e-060eeead7f22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:21:29.324422 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-9bf95f1a-19ef-493c-aa6f-f8c6f8f5247d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] Calling method '.version_select at 0x7f5f7dee4310>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:21:29.350984 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-9bf95f1a-19ef-493c-aa6f-f8c6f8f5247d tempest-TestMinimumBasicScenario-1039113142 tempest-TestMinimumBasicScenario-1039113142-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1413699766" status: 202 len: 0 microversion: 2.1 time: 0.031229 Jul 26 03:21:29.351558 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 489/954] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Jul 26 03:21:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1413699766 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:21:47.317082 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=14 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:21:47.317853 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:21:47.508114 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a4ac0953-00fa-4b31-935d-a9f15b967e46 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Action: 'create', calling method: .version_select at 0x7f5f796b7af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-799158817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUAVe1qhn+yMb8R7rGd98nh5hC+LkFI0joXxRapeSSMunfwwXFpiR6AGQSRNkwvW8dXU7ww7JjIDKYpWj15FKG/jcC/3DwPcngZsKd1hTmkG3Dqj8Me7a/S4gnLrdZiHA=="}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:21:47.523823 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-a4ac0953-00fa-4b31-935d-a9f15b967e46 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for project d582e70969cb448b86cd6c9ca31512ee. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:21:47.527917 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-a4ac0953-00fa-4b31-935d-a9f15b967e46 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for user 0b79af958ad24a8e91fc18110526e2d7 and project d582e70969cb448b86cd6c9ca31512ee. Resources: {'key_pairs'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:21:47.540066 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a4ac0953-00fa-4b31-935d-a9f15b967e46 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [e697351f-b994-4c34-9dfd-4092c08d2df0] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 03:21:48.551636 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [None req-a4ac0953-00fa-4b31-935d-a9f15b967e46 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [e697351f-b994-4c34-9dfd-4092c08d2df0] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37622. Jul 26 03:21:48.569540 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a4ac0953-00fa-4b31-935d-a9f15b967e46 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.257795 Jul 26 03:21:48.570133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 466/955] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Jul 26 03:21:47 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:22:06.193521 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1565681781", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-799158817", "security_groups": [{"name": "tempest-secgroup-smoke-1378346409"}], "block_device_mapping_v2": [{"uuid": "cc12f8fb-4120-4d58-abb2-f6bac19177a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05a6d8c8-75af-4261-9b6e-035a9059e17e"}]}} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:22:06.203627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:22:06.204267 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:22:06.313068 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.network.neutron [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] validate_networks() for [('05a6d8c8-75af-4261-9b6e-035a9059e17e', None, None, None, None, None)] {{(pid=118060) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:22:06.797562 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Flavor limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:22:06.797989 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Image limits 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:22:06.798457 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Flavor pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:22:06.798911 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Image pref 0:0:0 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:22:06.799337 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.virt.hardware [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118060) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:22:06.808795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:06.809237 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:06.810022 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:06.810452 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:06.828268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for project d582e70969cb448b86cd6c9ca31512ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:22:06.832694 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.quota [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for user 0b79af958ad24a8e91fc18110526e2d7 and project d582e70969cb448b86cd6c9ca31512ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118060) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:22:06.904070 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Going to run 1 instances... {{(pid=118060) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:22:06.906268 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc12f8fb-4120-4d58-abb2-f6bac19177a7',volume_size=None,volume_type=None)] {{(pid=118060) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:22:07.041285 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [f56a9f97-03fd-4726-8350-0df53e8989ed] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 03:22:08.049930 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [f56a9f97-03fd-4726-8350-0df53e8989ed] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37754. Jul 26 03:22:08.054753 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-e58da581-b939-4066-8031-0df5fb87b89d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.865957 Jul 26 03:22:08.055414 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 490/956] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:22:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:22:08.063931 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=4 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:22:08.065177 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:22:08.070317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-7f9d9e4c-4f7d-4c28-b3c2-dc2a43704f82 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:08.070915 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-7f9d9e4c-4f7d-4c28-b3c2-dc2a43704f82 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:08.130783 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-7f9d9e4c-4f7d-4c28-b3c2-dc2a43704f82 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:08.137649 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-7f9d9e4c-4f7d-4c28-b3c2-dc2a43704f82 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1094 microversion: 2.1 time: 0.075087 Jul 26 03:22:08.138204 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 467/957] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:08 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:09.161883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:09.162472 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:09.169425 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:09.169876 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:09.170698 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:09.171127 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:09.258200 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:09.266652 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-d46be99f-58de-4a1a-b850-e1f6e2eeebc8 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1200 microversion: 2.1 time: 0.112025 Jul 26 03:22:09.267417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 491/958] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:09 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:10.288803 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:10.289395 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:10.295844 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:10.296285 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:10.297039 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:10.297463 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:10.442852 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:10.451372 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-a92ba678-fbeb-42c0-b397-99d125647a58 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.166394 Jul 26 03:22:10.462145 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 468/959] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:10 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:10.563591 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-f18b009c-855a-4d78-9575-77c83be0b9f4 req-89d4187d-0687-4187-836e-6b61431ce9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4874008-caaa-41be-ae66-5c196f374af2", "tag": "b2154495-f266-4097-b15f-21b0cfed705d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:22:10.599944 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f18b009c-855a-4d78-9575-77c83be0b9f4 req-89d4187d-0687-4187-836e-6b61431ce9c3 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:10.601233 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-f18b009c-855a-4d78-9575-77c83be0b9f4 req-89d4187d-0687-4187-836e-6b61431ce9c3 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:10.614780 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-f18b009c-855a-4d78-9575-77c83be0b9f4 req-89d4187d-0687-4187-836e-6b61431ce9c3 service nova] Creating event network-changed:b2154495-f266-4097-b15f-21b0cfed705d for instance d4874008-caaa-41be-ae66-5c196f374af2 on hv-cinder-85084 Jul 26 03:22:10.620103 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-f18b009c-855a-4d78-9575-77c83be0b9f4 req-89d4187d-0687-4187-836e-6b61431ce9c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060122 Jul 26 03:22:10.621142 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 492/960] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:22:11.476620 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:11.477260 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:11.484423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:11.484871 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:11.485676 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:11.486125 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:11.621355 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:11.629153 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-aac214ea-e999-438e-b68c-820f78c47d32 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.156446 Jul 26 03:22:11.629961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 469/961] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:11 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:12.654728 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:12.655946 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:12.666499 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:12.667295 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:12.668539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:12.669243 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:12.807382 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:12.819534 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-942bee05-cb96-4c81-978c-320c510e15dc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.171620 Jul 26 03:22:12.820281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 493/962] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:12 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:13.848833 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:13.849960 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:13.859102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:13.859665 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:13.860836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:13.861325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:13.994060 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:14.001720 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-293f091a-87f0-42b8-86e4-7aa97fd8c3e1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.159593 Jul 26 03:22:14.002307 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 470/963] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:13 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:15.026137 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:15.026748 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:15.034006 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:15.034455 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:15.035366 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:15.035902 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:15.188918 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:15.201140 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3dc848e6-06d8-4de4-8284-0849e4be2966 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.178750 Jul 26 03:22:15.202082 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 494/964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:15 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:16.227967 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:16.228912 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:16.240109 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:16.240866 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:16.242127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:16.242888 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:16.391423 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:16.399800 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-145d70e3-a2ce-466b-ba5d-8b75479cc7cb tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.178530 Jul 26 03:22:16.400359 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 471/965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:16 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:17.430288 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:17.431119 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:17.434205 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:22:17.435128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=6 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:22:17.443164 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:17.443760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:17.444769 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:17.445340 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:17.580619 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:17.588585 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c15871fb-b055-41d8-b027-783f31ded77e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.163556 Jul 26 03:22:17.589122 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 495/966] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:17 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:18.613692 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:18.614256 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:18.617667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:22:18.624755 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:18.625376 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:18.626451 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:18.627070 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:18.767298 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:18.775363 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-39c057af-b709-48bd-8fa7-71cdaf637f2f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.168028 Jul 26 03:22:18.775925 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 472/967] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:18 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:19.796274 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:19.796955 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:19.803977 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:19.804429 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:19.805174 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:19.805597 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:19.937493 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:19.945676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5ad7fd49-8518-4c19-9bb1-53ee4ec2c2e4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.153335 Jul 26 03:22:19.946243 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 496/968] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:19 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:20.973962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:20.974923 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:20.986055 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:20.986910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:20.987729 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:20.988163 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:21.127380 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:21.135132 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ebc2347b-5c79-410d-99e8-1a1b9412f587 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.167749 Jul 26 03:22:21.135699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 473/969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:20 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:21.601905 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-b7ac5d3f-79e2-4f8c-990f-e078492d8554 req-5589cb4d-c701-43ba-ade5-b7f27dde82fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4874008-caaa-41be-ae66-5c196f374af2", "name": "network-vif-plugged", "status": "completed", "tag": "b2154495-f266-4097-b15f-21b0cfed705d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:22:21.612264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-b7ac5d3f-79e2-4f8c-990f-e078492d8554 req-5589cb4d-c701-43ba-ade5-b7f27dde82fb service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:21.612711 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-b7ac5d3f-79e2-4f8c-990f-e078492d8554 req-5589cb4d-c701-43ba-ade5-b7f27dde82fb service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:21.623666 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-b7ac5d3f-79e2-4f8c-990f-e078492d8554 req-5589cb4d-c701-43ba-ade5-b7f27dde82fb service nova] Creating event network-vif-plugged:b2154495-f266-4097-b15f-21b0cfed705d for instance d4874008-caaa-41be-ae66-5c196f374af2 on hv-cinder-85084 Jul 26 03:22:21.628901 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-b7ac5d3f-79e2-4f8c-990f-e078492d8554 req-5589cb4d-c701-43ba-ade5-b7f27dde82fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094143 Jul 26 03:22:21.629474 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 497/970] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:22:22.159585 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:22.160182 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:22.167828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:22.168321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:22.169151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:22.169623 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:22.309203 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:22.317378 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-481740b3-ff5f-4a83-a83d-d7b80869e2da tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.164258 Jul 26 03:22:22.317918 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 474/971] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:22 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:23.339147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:23.339762 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:23.346595 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:23.347079 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:23.347836 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:23.348263 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:23.480116 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:23.489551 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-5d2cb7a6-f61a-4126-91c3-94d534663a0b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1266 microversion: 2.1 time: 0.154893 Jul 26 03:22:23.489895 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 498/972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:23 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:24.514170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:24.515142 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:24.526230 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:24.527028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:24.528280 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:24.528996 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:24.665157 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:24.673042 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-18ad5e71-13b4-4350-b9da-ecc1057d0f9e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1453 microversion: 2.1 time: 0.165305 Jul 26 03:22:24.673607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 475/973] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:24 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:24.693872 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:22:24.694471 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:22:24.701578 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:24.702020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:24.702763 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:24.703349 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:24.835819 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:22:24.843791 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-6ec2e282-aaba-47df-a257-071046777a80 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1453 microversion: 2.1 time: 0.154282 Jul 26 03:22:24.844333 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 499/974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:22:24 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:22:26.515133 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-f6589604-0950-41aa-9ce6-413b273db8d5 req-65b6a414-a45f-4c36-aa9d-bb3ecd76d7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4874008-caaa-41be-ae66-5c196f374af2", "tag": "b2154495-f266-4097-b15f-21b0cfed705d"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:22:26.525216 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-f6589604-0950-41aa-9ce6-413b273db8d5 req-65b6a414-a45f-4c36-aa9d-bb3ecd76d7b5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:22:26.525656 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-f6589604-0950-41aa-9ce6-413b273db8d5 req-65b6a414-a45f-4c36-aa9d-bb3ecd76d7b5 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:22:26.536820 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-f6589604-0950-41aa-9ce6-413b273db8d5 req-65b6a414-a45f-4c36-aa9d-bb3ecd76d7b5 service nova] Creating event network-changed:b2154495-f266-4097-b15f-21b0cfed705d for instance d4874008-caaa-41be-ae66-5c196f374af2 on hv-cinder-85084 Jul 26 03:22:26.541919 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-f6589604-0950-41aa-9ce6-413b273db8d5 req-65b6a414-a45f-4c36-aa9d-bb3ecd76d7b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030560 Jul 26 03:22:26.542517 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 476/975] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:24:10.361730 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:24:10.362815 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Tue Jul 26 03:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:24:16.822812 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:24:16.823853 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Tue Jul 26 03:24:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:24:21.724702 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:24:21.725941 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=48 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:24:21.732124 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:21.732613 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:21.739958 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:21.740411 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:21.741182 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:21.741607 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:21.767460 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Going to try to terminate instance {{(pid=118060) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:24:21.851058 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4f1b3961-174e-42ae-819d-7822ff862b11 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 204 len: 0 microversion: 2.1 time: 0.129668 Jul 26 03:24:21.851915 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 500/976] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:24:21 2022] DELETE /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:24:21.858578 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e8616f4d-2bdc-41be-9e96-7a4473ec93d4] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 03:24:21.859955 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=22 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:24:21.860913 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=50 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:24:21.865441 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:21.866141 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:21.873283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:21.873726 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:21.874484 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:21.874913 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:22.012513 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:22.023132 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-54ccc350-1952-4fba-be9f-1d9ce3deb2f9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1577 microversion: 2.1 time: 0.166195 Jul 26 03:24:22.023876 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 477/977] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:21 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:23.046096 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:23.046857 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:23.054126 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:23.054599 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:23.055442 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:23.055897 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:23.202683 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:23.211134 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c64e4342-1b8f-4688-9524-4381566c90d4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1577 microversion: 2.1 time: 0.169597 Jul 26 03:24:23.211786 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 501/978] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:23 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:24.233102 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:24.233712 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:24.242585 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:24.243057 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:24.243851 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:24.244279 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:24.250016 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [-] [e8616f4d-2bdc-41be-9e96-7a4473ec93d4] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37860. Jul 26 03:24:24.310653 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:24.319422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-e5635ff2-a12d-42fd-ad18-575e89ca31b4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1509 microversion: 2.1 time: 0.090420 Jul 26 03:24:24.320011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 478/979] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:24 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1509 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:24.751890 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-72d8f255-90f4-420d-b6c2-06d111484a22 req-bf08d771-2d96-4899-b256-a1592622b237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4874008-caaa-41be-ae66-5c196f374af2", "name": "network-vif-deleted", "tag": "b2154495-f266-4097-b15f-21b0cfed705d"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:24:24.765933 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-72d8f255-90f4-420d-b6c2-06d111484a22 req-bf08d771-2d96-4899-b256-a1592622b237 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:24.766286 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-72d8f255-90f4-420d-b6c2-06d111484a22 req-bf08d771-2d96-4899-b256-a1592622b237 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:24.780101 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-72d8f255-90f4-420d-b6c2-06d111484a22 req-bf08d771-2d96-4899-b256-a1592622b237 service nova] Creating event network-vif-deleted:b2154495-f266-4097-b15f-21b0cfed705d for instance d4874008-caaa-41be-ae66-5c196f374af2 on hv-cinder-85084 Jul 26 03:24:24.786498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-72d8f255-90f4-420d-b6c2-06d111484a22 req-bf08d771-2d96-4899-b256-a1592622b237 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038108 Jul 26 03:24:24.788486 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 502/980] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:24:25.341074 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:25.341696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:25.348596 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:25.349049 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:25.349863 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:25.350294 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:25.383034 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:25.383472 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:25.383911 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.objects.instance [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lazy-loading 'fault' on Instance uuid d4874008-caaa-41be-ae66-5c196f374af2 {{(pid=118059) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 03:24:25.427836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:25.436244 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-d770e668-76b5-4e9b-9674-5ed1ccb35268 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 200 len: 1230 microversion: 2.1 time: 0.099160 Jul 26 03:24:25.436771 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 479/981] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:25 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:26.462885 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:26.464147 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:26.471825 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:26.472281 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:26.473051 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:26.473485 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:26.487294 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] HTTP exception thrown: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Request method failure captured: Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 HTTP/1.1 Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi313Gfn39iTjPVqaWGtMT3aopDjUsce2G8x-HraPd7rkIJkIhsHb_x0X_elaHHMX2L_P4DfiYUmYMl1jU1Lgd5t7b-IdGhbbmjenReEcDzmKiKSSgV4_72GoiszQ4E3zka-0iXSn7dv0hNNKCG78By71ggzrrrcSZs5HuMDKmNTl2SR4 Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:24:26.488947 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 0b79af958ad24a8e91fc18110526e2d7 Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:24:26.490627 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'd4874008-caaa-41be-ae66-5c196f374af2'} Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:24:26.491736 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:24:26.493364 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:24:26.494816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Returning 404 to user: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:24:26.494816 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-bee394a5-4c43-4505-a853-0c2146ccfbd5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 404 len: 111 microversion: 2.1 time: 0.034593 Jul 26 03:24:26.495285 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 503/982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:26 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:24:26.540983 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1494604917", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-799158817", "security_groups": [{"name": "tempest-secgroup-smoke-1378346409"}], "block_device_mapping_v2": [{"uuid": "cc12f8fb-4120-4d58-abb2-f6bac19177a7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05a6d8c8-75af-4261-9b6e-035a9059e17e"}]}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:24:26.657403 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] validate_networks() for [('05a6d8c8-75af-4261-9b6e-035a9059e17e', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:24:27.080799 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:24:27.081347 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:24:27.081827 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:24:27.082235 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:24:27.082645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:24:27.092218 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:27.092659 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:27.093493 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:27.093928 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:27.111040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for project d582e70969cb448b86cd6c9ca31512ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:24:27.115316 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for user 0b79af958ad24a8e91fc18110526e2d7 and project d582e70969cb448b86cd6c9ca31512ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:24:27.171956 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:24:27.174031 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc12f8fb-4120-4d58-abb2-f6bac19177a7',volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:24:27.309507 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-89e14ea0-39c3-41a1-8e2e-6b233602845e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772367 Jul 26 03:24:27.310138 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 480/983] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:24:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:24:27.321741 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c63826eb-d22f-4032-bb5f-0c6d52d92bb4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:27.322310 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c63826eb-d22f-4032-bb5f-0c6d52d92bb4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:27.375838 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c63826eb-d22f-4032-bb5f-0c6d52d92bb4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:27.383077 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c63826eb-d22f-4032-bb5f-0c6d52d92bb4 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1094 microversion: 2.1 time: 0.065193 Jul 26 03:24:27.383757 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 504/984] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:27 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:28.405019 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:28.405614 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:28.420721 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:28.421167 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:28.421974 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:28.422403 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:28.485509 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:28.493975 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-615dd930-ab88-48da-866e-9c61e65c2d56 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1210 microversion: 2.1 time: 0.093796 Jul 26 03:24:28.495344 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 481/985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:28 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:29.514442 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:29.515063 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:29.522523 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:29.522990 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:29.523765 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:29.524197 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:29.731302 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:29.738925 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-516a93ca-8141-45ab-8f63-a9c89b17a68f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.228343 Jul 26 03:24:29.739511 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 505/986] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:29 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:29.843325 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-b9d87603-c84d-4491-8878-a43fa767d74b req-5e577cce-6d6d-4d57-bfa0-53a6c3b6d835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fb36b0-3222-4f96-8b92-e274a296247d", "tag": "bc748c40-8c62-4981-b118-2bb23d7a57ff"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:24:29.860967 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-b9d87603-c84d-4491-8878-a43fa767d74b req-5e577cce-6d6d-4d57-bfa0-53a6c3b6d835 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:29.861413 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-b9d87603-c84d-4491-8878-a43fa767d74b req-5e577cce-6d6d-4d57-bfa0-53a6c3b6d835 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:29.873048 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-b9d87603-c84d-4491-8878-a43fa767d74b req-5e577cce-6d6d-4d57-bfa0-53a6c3b6d835 service nova] Creating event network-changed:bc748c40-8c62-4981-b118-2bb23d7a57ff for instance f3fb36b0-3222-4f96-8b92-e274a296247d on hv-cinder-85084 Jul 26 03:24:29.882662 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-b9d87603-c84d-4491-8878-a43fa767d74b req-5e577cce-6d6d-4d57-bfa0-53a6c3b6d835 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047530 Jul 26 03:24:29.883407 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 482/987] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:24:30.760339 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:30.761067 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:30.767951 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:30.768392 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:30.769145 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:30.769574 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:30.978187 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:30.986136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8e9bafd2-4f32-45a5-93f3-bf075f2e65a1 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.229669 Jul 26 03:24:30.986679 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 506/988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:30 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:32.013799 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:32.014442 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:32.021602 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:32.022040 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:32.022807 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:32.023268 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:32.161140 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:32.169029 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-52ccfc49-ab74-403d-babf-1eb613542cbd tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.162514 Jul 26 03:24:32.169599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 483/989] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:32 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:33.194594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:33.195700 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:33.206824 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:33.207623 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:33.208885 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:33.209599 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:33.347355 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:33.359264 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a1ddba6e-20c1-4a55-bd05-03636e3f6d6b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.171304 Jul 26 03:24:33.360078 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 507/990] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:33 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:34.380404 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:34.381008 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:34.388232 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:34.388684 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:34.389451 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:34.389883 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:34.527221 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:34.535398 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-132a391c-1204-494f-a2bc-10e40013edd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.159006 Jul 26 03:24:34.535929 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 484/991] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:34 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:35.560350 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:35.560985 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:35.568926 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:35.569431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:35.570273 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:35.570739 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:35.713327 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:35.725050 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-45758539-e39c-4f97-ad44-13adfc446d3b tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.170798 Jul 26 03:24:35.725795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 508/992] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:35 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:36.751615 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:36.752593 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:36.763387 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:36.763836 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:36.764570 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:36.765033 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:36.916849 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:36.924597 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b274f362-d396-402f-9e95-652b170e4709 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.179574 Jul 26 03:24:36.925197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 485/993] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:36 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:37.950665 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:37.951596 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:37.954052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:24:37.959540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:37.959976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:37.960726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:37.961190 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:38.096622 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:38.104559 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a488ff33-da3a-4133-a628-22adc6d86e69 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.161415 Jul 26 03:24:38.105118 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 509/994] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:37 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:39.136071 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:39.137085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:39.140152 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:24:39.141234 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=6 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:24:39.151677 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:39.152412 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:39.153634 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:39.154356 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:39.293207 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:39.301170 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-cffebab0-55c5-42a8-b164-415a21de2f10 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.171637 Jul 26 03:24:39.301759 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 486/995] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:39 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:40.322649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:40.323291 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:40.330007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:40.330454 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:40.331246 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:40.331683 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:40.389897 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-9c171c7a-5411-4b84-8289-7a38063fd0be req-bc976f13-c787-4776-a3dc-90e0dace6122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fb36b0-3222-4f96-8b92-e274a296247d", "name": "network-vif-plugged", "status": "completed", "tag": "bc748c40-8c62-4981-b118-2bb23d7a57ff"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:24:40.400795 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-9c171c7a-5411-4b84-8289-7a38063fd0be req-bc976f13-c787-4776-a3dc-90e0dace6122 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:40.401701 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-9c171c7a-5411-4b84-8289-7a38063fd0be req-bc976f13-c787-4776-a3dc-90e0dace6122 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:40.416283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-9c171c7a-5411-4b84-8289-7a38063fd0be req-bc976f13-c787-4776-a3dc-90e0dace6122 service nova] Creating event network-vif-plugged:bc748c40-8c62-4981-b118-2bb23d7a57ff for instance f3fb36b0-3222-4f96-8b92-e274a296247d on hv-cinder-85084 Jul 26 03:24:40.421529 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-9c171c7a-5411-4b84-8289-7a38063fd0be req-bc976f13-c787-4776-a3dc-90e0dace6122 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Jul 26 03:24:40.422132 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 487/996] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:24:40.472299 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:40.480007 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-b191f713-1213-4ca6-9dee-b881ff0b2ed2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.161354 Jul 26 03:24:40.480564 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 510/997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:40 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:41.506707 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:41.507907 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:41.518557 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:41.519373 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:41.520638 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:41.521372 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:41.664870 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:41.672851 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-6a3809e4-cf46-4452-a1a5-a279b1364dee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1266 microversion: 2.1 time: 0.174025 Jul 26 03:24:41.673385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 488/998] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:41 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:42.694454 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22e35ba5-34c3-41b5-868f-95cb5f24d3d5] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:24:42.700140 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:42.701134 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:42.711528 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:42.712271 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:42.713522 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:42.714233 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:42.855726 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:42.863675 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a0449a04-9065-4618-a7e1-98481f912bd7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1453 microversion: 2.1 time: 0.171596 Jul 26 03:24:42.864242 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 511/999] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:42 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:42.884422 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:24:42.885028 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:24:42.891925 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:42.892406 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:42.893167 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:42.893599 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:43.031695 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:24:43.039957 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-9a86dd7d-3493-4eb9-a633-be47950357ee tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1453 microversion: 2.1 time: 0.159591 Jul 26 03:24:43.040510 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 489/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:24:42 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:24:44.643629 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-9dcc1d67-6c25-4295-9a59-6f539c0c1b1c req-5f0a6d24-882a-44d1-9763-92bdb891fd01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fb36b0-3222-4f96-8b92-e274a296247d", "tag": "bc748c40-8c62-4981-b118-2bb23d7a57ff"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:24:44.654903 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9dcc1d67-6c25-4295-9a59-6f539c0c1b1c req-5f0a6d24-882a-44d1-9763-92bdb891fd01 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:24:44.655380 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-9dcc1d67-6c25-4295-9a59-6f539c0c1b1c req-5f0a6d24-882a-44d1-9763-92bdb891fd01 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:24:44.667805 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-9dcc1d67-6c25-4295-9a59-6f539c0c1b1c req-5f0a6d24-882a-44d1-9763-92bdb891fd01 service nova] Creating event network-changed:bc748c40-8c62-4981-b118-2bb23d7a57ff for instance f3fb36b0-3222-4f96-8b92-e274a296247d on hv-cinder-85084 Jul 26 03:24:44.672883 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-9dcc1d67-6c25-4295-9a59-6f539c0c1b1c req-5f0a6d24-882a-44d1-9763-92bdb891fd01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033337 Jul 26 03:24:44.673488 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 512/1001] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:26:18.904856 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:26:18.905607 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=68 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:26:18.909842 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-839915467", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-799158817", "security_groups": [{"name": "tempest-secgroup-smoke-1378346409"}], "block_device_mapping_v2": [{"uuid": "164aa361-7e87-4d98-bd54-c1faa5f1cb7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05a6d8c8-75af-4261-9b6e-035a9059e17e"}]}} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:26:19.140819 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.network.neutron [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] validate_networks() for [('05a6d8c8-75af-4261-9b6e-035a9059e17e', None, None, None, None, None)] {{(pid=118059) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 03:26:19.522429 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Flavor limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 03:26:19.523144 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Image limits 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 03:26:19.523899 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Flavor pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 03:26:19.524562 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Image pref 0:0:0 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 03:26:19.525127 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.virt.hardware [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118059) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 03:26:19.535379 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:19.535827 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:19.536624 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:19.537058 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:19.555557 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for project d582e70969cb448b86cd6c9ca31512ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 03:26:19.559962 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.quota [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Getting quotas for user 0b79af958ad24a8e91fc18110526e2d7 and project d582e70969cb448b86cd6c9ca31512ee. Resources: {'instances', 'ram', 'cores'} {{(pid=118059) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 03:26:19.619868 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Going to run 1 instances... {{(pid=118059) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 03:26:19.621966 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='164aa361-7e87-4d98-bd54-c1faa5f1cb7f',volume_size=None,volume_type=None)] {{(pid=118059) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 03:26:19.768504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-92b8766d-af37-4d35-b510-54ec1aadf61e tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.865585 Jul 26 03:26:19.769144 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 490/1002] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Jul 26 03:26:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 03:26:19.778054 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:26:19.778745 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:26:19.779943 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] [22e35ba5-34c3-41b5-868f-95cb5f24d3d5] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37936. Jul 26 03:26:19.784433 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-29c61a38-bced-414c-8107-a195320d2f95 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:19.785130 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-29c61a38-bced-414c-8107-a195320d2f95 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:19.901691 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-29c61a38-bced-414c-8107-a195320d2f95 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:19.908517 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-29c61a38-bced-414c-8107-a195320d2f95 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1093 microversion: 2.1 time: 0.132202 Jul 26 03:26:19.909219 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 513/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:19 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1093 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:20.929645 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:20.930233 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:20.939022 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:20.939714 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:20.940809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:20.941396 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:21.020547 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:21.028194 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-31cfb027-f8d3-4f6f-a167-e4d2775f0021 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1209 microversion: 2.1 time: 0.102512 Jul 26 03:26:21.028725 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 491/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:20 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:22.050703 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:22.051216 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:22.058540 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:22.059168 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:22.060187 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:22.061235 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:22.253148 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:22.260850 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-52949ae6-3b85-4920-9caf-e514bf2ca136 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.214936 Jul 26 03:26:22.261458 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 514/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:22 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:22.363855 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-8cd6eba8-127e-4d68-8bd3-60ea193afba9 req-4840008d-72c5-4932-b05c-f371b8f97f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed1fbe3-3916-48ef-b1a9-9cb8dde96057", "tag": "ddecead8-0c75-44ac-a4a4-9d96aeeb78ac"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:26:22.375761 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-8cd6eba8-127e-4d68-8bd3-60ea193afba9 req-4840008d-72c5-4932-b05c-f371b8f97f1e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:22.376264 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-8cd6eba8-127e-4d68-8bd3-60ea193afba9 req-4840008d-72c5-4932-b05c-f371b8f97f1e service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:22.392606 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-8cd6eba8-127e-4d68-8bd3-60ea193afba9 req-4840008d-72c5-4932-b05c-f371b8f97f1e service nova] Creating event network-changed:ddecead8-0c75-44ac-a4a4-9d96aeeb78ac for instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 on hv-cinder-85084 Jul 26 03:26:22.397973 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-8cd6eba8-127e-4d68-8bd3-60ea193afba9 req-4840008d-72c5-4932-b05c-f371b8f97f1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040006 Jul 26 03:26:22.398608 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 492/1006] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:26:23.281428 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:23.282012 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:23.288815 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:23.289260 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:23.290020 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:23.290447 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:23.480712 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:23.489028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-93fa960d-e983-4f24-9a8c-aba56c6a40a6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.211534 Jul 26 03:26:23.489562 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 515/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:23 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:24.515898 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:24.517113 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:24.527150 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:24.527598 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:24.528371 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:24.528807 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:24.664812 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:24.677367 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-04e1d1ad-c40c-40c7-882d-d0d621b95abc tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.169155 Jul 26 03:26:24.678205 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 493/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:24 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:25.700373 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:25.701071 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:25.707792 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:25.708676 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:25.709000 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:25.709431 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:25.839649 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:25.847568 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-833a1608-02eb-494b-b984-844241462a8f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.151145 Jul 26 03:26:25.848128 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 516/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:25 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:26.872459 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:26.873214 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:26.881762 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:26.882317 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:26.883305 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:26.883854 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:27.023429 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:27.031067 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-724450a6-2830-4b9e-acd4-7dd438df98b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.164405 Jul 26 03:26:27.031632 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 494/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:26 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:28.052417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:28.053018 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:28.060012 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:28.060811 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:28.061565 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:28.061991 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:28.195673 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:28.203893 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-8db1292a-044e-4d32-8e94-1bab99beecdf tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.155429 Jul 26 03:26:28.204427 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 517/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:28 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:29.232868 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:29.233851 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:29.245200 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:29.245747 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:29.246521 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:29.246977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:29.393692 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:29.405270 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-1bf4b3c0-ff9b-498b-9122-9b81f8f54f30 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.178669 Jul 26 03:26:29.406121 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 495/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:29 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:30.435760 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:30.436635 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:30.440456 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell0:SELECT=2 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:26:30.449349 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:30.449804 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:30.450566 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:30.451028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:30.584824 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:30.592636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-a002ef42-6d21-453b-8696-efebfed0d553 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.163965 Jul 26 03:26:30.593199 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 518/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:30 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:31.618012 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:31.618830 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:31.622024 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=2 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:26:31.623168 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell0:SELECT=6 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:26:31.635385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:31.635975 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:31.636733 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:31.637159 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:31.777680 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:31.785827 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-67436fe0-e861-466c-b650-b6ce2d83e5ef tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.174629 Jul 26 03:26:31.786385 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 496/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:31 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:32.807764 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:32.808381 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:32.816025 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:32.816490 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:32.817272 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:32.817690 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:32.823659 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-30933a8d-00bc-4ec1-9301-8e7ba03f957d req-8a3b856a-69f8-48f8-91e0-8150e37d83ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed1fbe3-3916-48ef-b1a9-9cb8dde96057", "name": "network-vif-plugged", "status": "completed", "tag": "ddecead8-0c75-44ac-a4a4-9d96aeeb78ac"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:26:32.836291 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-30933a8d-00bc-4ec1-9301-8e7ba03f957d req-8a3b856a-69f8-48f8-91e0-8150e37d83ee service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:32.837819 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-30933a8d-00bc-4ec1-9301-8e7ba03f957d req-8a3b856a-69f8-48f8-91e0-8150e37d83ee service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:32.863151 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-30933a8d-00bc-4ec1-9301-8e7ba03f957d req-8a3b856a-69f8-48f8-91e0-8150e37d83ee service nova] Creating event network-vif-plugged:ddecead8-0c75-44ac-a4a4-9d96aeeb78ac for instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 on hv-cinder-85084 Jul 26 03:26:32.868782 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-30933a8d-00bc-4ec1-9301-8e7ba03f957d req-8a3b856a-69f8-48f8-91e0-8150e37d83ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049370 Jul 26 03:26:32.869573 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 497/1015] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:26:32.953166 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:32.961070 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2e89e521-0d22-41e0-91e1-096bf9ba5442 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.157918 Jul 26 03:26:32.961863 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 519/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:32 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:33.986750 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:33.987996 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:33.999505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:34.000237 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:34.001485 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:34.002200 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:34.412712 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:34.425254 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-60db3c37-b1fc-4a64-ab4e-b5dae11cef6d tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1265 microversion: 2.1 time: 0.445369 Jul 26 03:26:34.426118 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 498/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:33 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1265 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:35.452762 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:35.453687 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:35.464817 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:35.465498 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:35.466788 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:35.467532 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:35.611702 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:35.619347 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-26ee304e-d117-4ea3-b95a-20885afcf0b5 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1453 microversion: 2.1 time: 0.173150 Jul 26 03:26:35.619881 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 520/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:35 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:35.639655 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:26:35.640201 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:26:35.647357 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:35.647801 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:35.648554 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:35.648977 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:35.788516 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:26:35.796411 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b5093b36-eb75-4c6e-a842-4052d7660dab tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1453 microversion: 2.1 time: 0.160774 Jul 26 03:26:35.796947 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 499/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:26:35 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:26:37.718735 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-3d912eb9-0591-4e41-812a-c694c1cd5dca req-44fcd9f5-e372-40da-adde-00b33585a6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed1fbe3-3916-48ef-b1a9-9cb8dde96057", "tag": "ddecead8-0c75-44ac-a4a4-9d96aeeb78ac"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:26:37.728363 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-3d912eb9-0591-4e41-812a-c694c1cd5dca req-44fcd9f5-e372-40da-adde-00b33585a6cb service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:26:37.728728 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-3d912eb9-0591-4e41-812a-c694c1cd5dca req-44fcd9f5-e372-40da-adde-00b33585a6cb service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:26:37.740081 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-3d912eb9-0591-4e41-812a-c694c1cd5dca req-44fcd9f5-e372-40da-adde-00b33585a6cb service nova] Creating event network-changed:ddecead8-0c75-44ac-a4a4-9d96aeeb78ac for instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 on hv-cinder-85084 Jul 26 03:26:37.745247 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-3d912eb9-0591-4e41-812a-c694c1cd5dca req-44fcd9f5-e372-40da-adde-00b33585a6cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083338 Jul 26 03:26:37.745822 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 521/1020] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:27:27.236389 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:27:27.237513 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Tue Jul 26 03:27:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:27:27.425739 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:27:27.426629 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Tue Jul 26 03:27:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:27:36.837028 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:27:36.838011 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Tue Jul 26 03:27:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:28:17.542898 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_api:SELECT=20 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:28:17.543583 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:17.543583 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:17.544976 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG dbcounter [-] [118060] Writing DB stats nova_cell1:SELECT=44 {{(pid=118060) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:28:17.549691 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:28:17.550196 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-346bb869-b9c6-4f1a-bf09-0f7433766175 req-d542b645-9522-4660-a6ad-3d6746c1ea0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed1fbe3-3916-48ef-b1a9-9cb8dde96057", "tag": "ddecead8-0c75-44ac-a4a4-9d96aeeb78ac"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:28:17.550347 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG dbcounter [-] [118059] Writing DB stats nova_cell1:SELECT=48 {{(pid=118059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 03:28:17.551895 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:17.552321 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:17.553324 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:17.553928 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:17.561357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-346bb869-b9c6-4f1a-bf09-0f7433766175 req-d542b645-9522-4660-a6ad-3d6746c1ea0f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:17.561843 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-346bb869-b9c6-4f1a-bf09-0f7433766175 req-d542b645-9522-4660-a6ad-3d6746c1ea0f service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:17.573475 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-346bb869-b9c6-4f1a-bf09-0f7433766175 req-d542b645-9522-4660-a6ad-3d6746c1ea0f service nova] Creating event network-changed:ddecead8-0c75-44ac-a4a4-9d96aeeb78ac for instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 on hv-cinder-85084 Jul 26 03:28:17.579176 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-346bb869-b9c6-4f1a-bf09-0f7433766175 req-d542b645-9522-4660-a6ad-3d6746c1ea0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038192 Jul 26 03:28:17.579772 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 522/1021] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:28:17.582877 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:28:17.675828 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-ab698ed8-5211-492c-bb85-f1ba47203329 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 204 len: 0 microversion: 2.1 time: 0.137075 Jul 26 03:28:17.676475 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 500/1022] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:28:17 2022] DELETE /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:28:17.686172 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:17.686866 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:17.693448 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:17.693891 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:17.694651 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:17.695105 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:17.846786 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:28:17.854573 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-4bbd19f4-890a-434b-8d7d-865ecc60fca6 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1577 microversion: 2.1 time: 0.173207 Jul 26 03:28:17.855136 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 523/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:17 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 03:28:18.881086 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:18.882197 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:18.891831 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:18.892279 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:18.893043 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:18.893480 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:19.034122 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:28:19.041881 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-fdb79f98-d450-45b5-83a3-3ad3591673db tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1577 microversion: 2.1 time: 0.168053 Jul 26 03:28:19.042456 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 501/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:18 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:28:20.022455 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-05ea8a2e-72dc-4f3d-8a7b-57631e647da6 req-9264e08f-fbbd-487e-80a5-8db56bbd5b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed1fbe3-3916-48ef-b1a9-9cb8dde96057", "name": "network-vif-deleted", "tag": "ddecead8-0c75-44ac-a4a4-9d96aeeb78ac"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:28:20.032159 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-05ea8a2e-72dc-4f3d-8a7b-57631e647da6 req-9264e08f-fbbd-487e-80a5-8db56bbd5b7d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:20.032594 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-05ea8a2e-72dc-4f3d-8a7b-57631e647da6 req-9264e08f-fbbd-487e-80a5-8db56bbd5b7d service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:20.043366 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-05ea8a2e-72dc-4f3d-8a7b-57631e647da6 req-9264e08f-fbbd-487e-80a5-8db56bbd5b7d service nova] Creating event network-vif-deleted:ddecead8-0c75-44ac-a4a4-9d96aeeb78ac for instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 on hv-cinder-85084 Jul 26 03:28:20.048171 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-05ea8a2e-72dc-4f3d-8a7b-57631e647da6 req-9264e08f-fbbd-487e-80a5-8db56bbd5b7d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091836 Jul 26 03:28:20.048739 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 524/1025] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:28:20.064212 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:20.064818 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:20.071460 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:20.071910 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:20.072667 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:20.073098 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:20.141364 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:28:20.149505 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-53922bdd-f579-4e86-b79e-e948061d4009 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 200 len: 1224 microversion: 2.1 time: 0.089526 Jul 26 03:28:20.150059 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 502/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:20 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:28:21.175639 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:21.176762 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: bed1fbe3-3916-48ef-b1a9-9cb8dde96057] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:21.187663 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:21.188417 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:21.189664 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:21.190360 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:21.208717 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] HTTP exception thrown: Instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 could not be found. Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Request method failure captured: Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 HTTP/1.1 Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi313Gfn39iTjPVqaWGtMT3aopDjUsce2G8x-HraPd7rkIJkIhsHb_x0X_elaHHMX2L_P4DfiYUmYMl1jU1Lgd5t7b-IdGhbbmjenReEcDzmKiKSSgV4_72GoiszQ4E3zka-0iXSn7dv0hNNKCG78By71ggzrrrcSZs5HuMDKmNTl2SR4 Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:28:21.210319 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 0b79af958ad24a8e91fc18110526e2d7 Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 could not be found. Jul 26 03:28:21.212043 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'bed1fbe3-3916-48ef-b1a9-9cb8dde96057'} Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 could not be found. Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:28:21.213015 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 could not be found. Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 could not be found. Jul 26 03:28:21.214634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:21.216061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Returning 404 to user: Instance bed1fbe3-3916-48ef-b1a9-9cb8dde96057 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:28:21.216061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-72b1f17c-ecff-40b5-8f69-d003c40c3847 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057" status: 404 len: 111 microversion: 2.1 time: 0.043975 Jul 26 03:28:21.216061 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 525/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:21 2022] GET /compute/v2.1/servers/bed1fbe3-3916-48ef-b1a9-9cb8dde96057 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:28:24.295804 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:24.296343 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:24.297634 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [req-131fb77b-8f94-4bf9-a26a-3f54728f6e36 req-af4e34fb-d784-42ee-9c90-7fcaf07bd3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fb36b0-3222-4f96-8b92-e274a296247d", "tag": "bc748c40-8c62-4981-b118-2bb23d7a57ff"}]} {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:28:24.303275 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:24.303809 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:24.304654 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:24.305184 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:24.308778 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-131fb77b-8f94-4bf9-a26a-3f54728f6e36 req-af4e34fb-d784-42ee-9c90-7fcaf07bd3aa service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:24.309214 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [req-131fb77b-8f94-4bf9-a26a-3f54728f6e36 req-af4e34fb-d784-42ee-9c90-7fcaf07bd3aa service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:24.321861 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.compute.server_external_events [req-131fb77b-8f94-4bf9-a26a-3f54728f6e36 req-af4e34fb-d784-42ee-9c90-7fcaf07bd3aa service nova] Creating event network-changed:bc748c40-8c62-4981-b118-2bb23d7a57ff for instance f3fb36b0-3222-4f96-8b92-e274a296247d on hv-cinder-85084 Jul 26 03:28:24.327362 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [req-131fb77b-8f94-4bf9-a26a-3f54728f6e36 req-af4e34fb-d784-42ee-9c90-7fcaf07bd3aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033181 Jul 26 03:28:24.328603 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 526/1028] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 03:28:24.333113 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Going to try to terminate instance {{(pid=118059) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 03:28:24.421626 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-558aaf2b-4f6c-4010-85ad-21af51e86e48 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 204 len: 0 microversion: 2.1 time: 0.129130 Jul 26 03:28:24.424945 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 503/1029] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:28:24 2022] DELETE /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 03:28:24.430668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:24.431822 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:24.439653 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:24.440538 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:24.441544 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:24.442191 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:24.582492 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:28:24.590201 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-c8eb0a47-07bc-476a-9331-4fc61706e41f tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1578 microversion: 2.1 time: 0.163741 Jul 26 03:28:24.590727 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 527/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:24 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:28:25.616974 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:25.618181 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:25.629283 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:25.630085 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:25.631455 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:25.632185 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:25.826699 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.policy [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118059) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:28:25.834696 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-0857e171-7944-49a5-b808-50bd70d5cef7 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1578 microversion: 2.1 time: 0.224961 Jul 26 03:28:25.835306 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 504/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:25 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:28:26.856576 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:26.857156 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:26.865162 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:26.865802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:26.866581 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:26.867008 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:26.937090 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [req-89f5c641-a844-4feb-a555-049413dbdaa6 req-51f3a1e4-6c61-41db-bfbb-46652738dc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fb36b0-3222-4f96-8b92-e274a296247d", "name": "network-vif-deleted", "tag": "bc748c40-8c62-4981-b118-2bb23d7a57ff"}]} {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 03:28:26.948769 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-89f5c641-a844-4feb-a555-049413dbdaa6 req-51f3a1e4-6c61-41db-bfbb-46652738dc35 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:26.949224 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [req-89f5c641-a844-4feb-a555-049413dbdaa6 req-51f3a1e4-6c61-41db-bfbb-46652738dc35 service nova] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:26.951733 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.policy [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b79af958ad24a8e91fc18110526e2d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd582e70969cb448b86cd6c9ca31512ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118060) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 03:28:26.960477 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-2b8856d2-d573-46bc-8bb8-9b0b479132ce tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 200 len: 1391 microversion: 2.1 time: 0.107768 Jul 26 03:28:26.961111 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 528/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:26 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 1391 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 03:28:26.961386 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.compute.server_external_events [req-89f5c641-a844-4feb-a555-049413dbdaa6 req-51f3a1e4-6c61-41db-bfbb-46652738dc35 service nova] Creating event network-vif-deleted:bc748c40-8c62-4981-b118-2bb23d7a57ff for instance f3fb36b0-3222-4f96-8b92-e274a296247d on hv-cinder-85084 Jul 26 03:28:26.968851 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [req-89f5c641-a844-4feb-a555-049413dbdaa6 req-51f3a1e4-6c61-41db-bfbb-46652738dc35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035759 Jul 26 03:28:26.969482 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 505/1033] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 26 03:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 03:28:27.982027 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:27.982636 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: f3fb36b0-3222-4f96-8b92-e274a296247d] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:27.989701 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:27.990146 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:27.990894 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:27.991357 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:28.005092 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] HTTP exception thrown: Instance f3fb36b0-3222-4f96-8b92-e274a296247d could not be found. Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Request method failure captured: Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d HTTP/1.1 Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi313Gfn39iTjPVqaWGtMT3aopDjUsce2G8x-HraPd7rkIJkIhsHb_x0X_elaHHMX2L_P4DfiYUmYMl1jU1Lgd5t7b-IdGhbbmjenReEcDzmKiKSSgV4_72GoiszQ4E3zka-0iXSn7dv0hNNKCG78By71ggzrrrcSZs5HuMDKmNTl2SR4 Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:28:28.006755 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 0b79af958ad24a8e91fc18110526e2d7 Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance f3fb36b0-3222-4f96-8b92-e274a296247d could not be found. Jul 26 03:28:28.008506 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'f3fb36b0-3222-4f96-8b92-e274a296247d'} Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fb36b0-3222-4f96-8b92-e274a296247d could not be found. Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:28:28.009668 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fb36b0-3222-4f96-8b92-e274a296247d could not be found. Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fb36b0-3222-4f96-8b92-e274a296247d could not be found. Jul 26 03:28:28.011218 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.012655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Returning 404 to user: Instance f3fb36b0-3222-4f96-8b92-e274a296247d could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:28:28.012655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-432f7470-813e-4d5c-8dd2-b1905248faa2 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d" status: 404 len: 111 microversion: 2.1 time: 0.030106 Jul 26 03:28:28.012655 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 529/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:27 2022] GET /compute/v2.1/servers/f3fb36b0-3222-4f96-8b92-e274a296247d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:28:28.476502 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:28.477058 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.compute.api [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118059) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:28.484180 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:28.484652 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:28.485453 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:28.485880 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG oslo_concurrency.lockutils [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:28.499304 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.wsgi [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] HTTP exception thrown: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Request method failure captured: Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: request: DELETE /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 HTTP/1.1 Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept: application/json Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Accept-Encoding: identity Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Connection: close Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Length: 0 Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Content-Type: application/json Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Host: 10.222.0.42 Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Openstack-System-Scope: None Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: User-Agent: python-urllib3/1.26.10 Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Auth-Token: gAAAAABi313Gfn39iTjPVqaWGtMT3aopDjUsce2G8x-HraPd7rkIJkIhsHb_x0X_elaHHMX2L_P4DfiYUmYMl1jU1Lgd5t7b-IdGhbbmjenReEcDzmKiKSSgV4_72GoiszQ4E3zka-0iXSn7dv0hNNKCG78By71ggzrrrcSZs5HuMDKmNTl2SR4 Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Id: None Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Domain-Name: None Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Identity-Status: Confirmed Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Is-Admin-Project: True Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Id: default Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Domain-Name: Default Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Project-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Role: reader,member Jul 26 03:28:28.500961 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Roles: reader,member Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-Tenant-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Id: default Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Domain-Name: Default Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Id: 0b79af958ad24a8e91fc18110526e2d7 Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: X-User-Name: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: method: > Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: exception: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.502504 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: action_args: {'id': 'd4874008-caaa-41be-ae66-5c196f374af2'} Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:28:28.503481 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.505011 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.506802 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Returning 404 to user: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. {{(pid=118059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:28:28.506802 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-25f2b8d0-2c10-4595-b292-769d16933cfe tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 404 len: 111 microversion: 2.1 time: 0.030105 Jul 26 03:28:28.506802 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 506/1035] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Jul 26 03:28:28 2022] DELETE /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:28:28.510887 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '>' {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:28.511532 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.compute.api [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] [instance: d4874008-caaa-41be-ae66-5c196f374af2] Fetching instance by UUID {{(pid=118060) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 03:28:28.522064 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:28.522708 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:28.523539 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 03:28:28.523961 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG oslo_concurrency.lockutils [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Lock "f14e75b2-f05e-40ea-9398-2d8da20a61a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118060) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 03:28:28.538494 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.wsgi [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] HTTP exception thrown: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Request method failure captured: Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: request: GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 HTTP/1.1 Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept: application/json Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Accept-Encoding: identity Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Connection: close Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Length: 0 Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Content-Type: application/json Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Host: 10.222.0.42 Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Openstack-System-Scope: None Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: User-Agent: python-urllib3/1.26.10 Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Auth-Token: gAAAAABi313Gfn39iTjPVqaWGtMT3aopDjUsce2G8x-HraPd7rkIJkIhsHb_x0X_elaHHMX2L_P4DfiYUmYMl1jU1Lgd5t7b-IdGhbbmjenReEcDzmKiKSSgV4_72GoiszQ4E3zka-0iXSn7dv0hNNKCG78By71ggzrrrcSZs5HuMDKmNTl2SR4 Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Id: None Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Domain-Name: None Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Identity-Status: Confirmed Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Is-Admin-Project: True Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Id: default Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Domain-Name: Default Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Project-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Role: reader,member Jul 26 03:28:28.540052 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Roles: reader,member Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d582e70969cb448b86cd6c9ca31512ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}] Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Id: d582e70969cb448b86cd6c9ca31512ee Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-Tenant-Name: tempest-TestVolumeBootPattern-1179006534 Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Id: default Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Domain-Name: Default Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Id: 0b79af958ad24a8e91fc18110526e2d7 Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: X-User-Name: tempest-TestVolumeBootPattern-1179006534-project Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: method: > Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: exception: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.541795 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: action_args: {'id': 'd4874008-caaa-41be-ae66-5c196f374af2'} Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: {{(pid=118060) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 03:28:28.542802 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. Jul 26 03:28:28.544537 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: ERROR nova.api.openstack.wsgi Jul 26 03:28:28.545948 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: DEBUG nova.api.openstack.wsgi [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Returning 404 to user: Instance d4874008-caaa-41be-ae66-5c196f374af2 could not be found. {{(pid=118060) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 03:28:28.545948 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO nova.api.openstack.requestlog [None req-3c070b16-20fb-4471-bbbc-a210c4353d20 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2" status: 404 len: 111 microversion: 2.1 time: 0.034378 Jul 26 03:28:28.545948 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: [pid: 118060|app: 0|req: 530/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Jul 26 03:28:28 2022] GET /compute/v2.1/servers/d4874008-caaa-41be-ae66-5c196f374af2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 03:28:29.881771 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: DEBUG nova.api.openstack.wsgi [None req-b5f8e072-a894-45d6-be30-bf363fc617b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] Calling method '.version_select at 0x7f5f795240d0>' {{(pid=118059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 03:28:29.907489 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO nova.api.openstack.requestlog [None req-b5f8e072-a894-45d6-be30-bf363fc617b9 tempest-TestVolumeBootPattern-1179006534 tempest-TestVolumeBootPattern-1179006534-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-799158817" status: 202 len: 0 microversion: 2.1 time: 0.030120 Jul 26 03:28:29.908075 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: [pid: 118059|app: 0|req: 507/1037] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Jul 26 03:28:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-799158817 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 03:29:10.377304 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:29:10.378658 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Tue Jul 26 03:29:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:30:47.249931 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:30:47.250449 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Tue Jul 26 03:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:30:56.850455 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:30:56.851753 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Tue Jul 26 03:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:31:09.958468 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:31:09.959784 dv-cinder-850840-2-iscsi devstack@n-api.service[118060]: Tue Jul 26 03:31:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:31:24.251349 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:31:24.252354 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Tue Jul 26 03:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 03:32:30.390825 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:32:30.391974 dv-cinder-850840-2-iscsi devstack@n-api.service[118059]: Tue Jul 26 03:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!